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Preface 


Differential equations are widely used by mathematicians, physicists, engineers, biol- 
ogists, chemists, and scientists who work in relevant fields. They encounter the use of 
differential equations in the study of Newton’s law of cooling, Maxwell’s equations, 
Newton’s laws of motion, fluid dynamics equations, equations in plasma dynamics, 
equations in stellar dynamics, Hook’s law, Schrédinger’s equation, acoustic wave 
equation, equations in chemical kinetics, equations in thermodynamics, Einstein’s 
equations for general relativity, population models, epidemics, and so on. For many 
years, the author has been encouraged by the graduate students at the University of 
Dayton to write a concise and reader-friendly book on the subject of advanced dif- 
ferential equations. So this book grew out of lecture notes that the author has been 
constantly revising and using for a graduate course in differential equations. The 
book should serve as a two-semester graduate textbook in exploring the theory and 
applications of ordinary differential equations and differential equations with delays. 
It is intended for students who have basic knowledge of ordinary differential equa- 
tions and real analysis. While writing this book, the author tried to balance rigor 
and presenting the most difficult material in an elementary format by adopting easier 
and friendlier notations that make the book accessible to a wide audience. It was the 
author’s main intention to provide many examples to illustrate the theory conveyed 
in the theorems. The author made every effort to include contemporary topics such 
as the use of fixed point theory in several places to prove the existence and unique- 
ness, various notions of stability, and the existence of positive periodic solutions on 
Banach spaces. What makes the book appealing and distinguished from other books 
is the addition of Chapters 8 and 9 on delay differential equations with advanced 
topics. The author is convinced that any student who completes the whole book, es- 
pecially Chapters 8 and 9, should be ready to carry on with meaningful research in 
delay differential systems. 


Much of the pedagogical and mathematical development of this book is influ- 
enced by the author’s style of presentation. The literature on differential equations is 
vast and well established, and some of the ideas found their way into this book. 


Since stability is the central part of this book, namely by the Lyapunov method, 
we must mention some history. Lyapunov functions are named after Alexander 
Lyapunov, a Russian mathematician, who in 1892 published his book The General 
Problem of Stability of Motion. Lyapunov was the first to consider the modifications 
necessary in nonlinear systems to the linear theory of stability based on lineariz- 
ing near a point of equilibrium. His work, initially published in Russian and then 
translated to French, received little attention for many years. Interest in Lyapunov 
stability started suddenly during the Cold War period when his method was found to 
be applicable to the stability of aerospace guidance systems, which typically contain 


xi 
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strong nonlinearities not treatable by other methods. More recently, the concept of 
the Lyapunov exponent related to Lyapunov’s first method of discussing stability has 
received wide interest in connection with chaos theory. 


Chapter | deals with various introductory topics, including variation of parame- 
ters formula, metric spaces, and Banach spaces. 


In Chapter 2 we introduce Gronwall’s inequality that we make use of to prove the 
uniqueness of solutions. We introduce theorems on the existence and uniqueness of 
solutions, their dependence on initial data, and their continuation on maximal inter- 
val. 


In Chapter 3 we introduce systems of differential equations. We briefly discuss 
how the existence and uniqueness theorems of Chapter 2 are extended to suit systems. 
Then we develop the notion of the fundamental matrix as a solution and utilize it to 
write solutions of non-homogeneous systems so that they can be analyzed. 


Stability theory is the central part of this book. Chapters 4-8 are totally devoted 
to stability. In Chapter 4 we are mainly concerned with the stability of linear systems 
via the variation of parameters. The chapter also includes a nice section of Floquet 
theory with its application to Mathieu’s equation. 


Chapters 5 and 6 are deeply devoted to the study of the stability of linear systems, 
near-linear systems, perturbed systems, autonomous systems in the plane, and stabil- 
ity by linearization. Chapter 5 is ended with the study of Hamiltonians and gradient 
systems. We begin Chapter 6 by looking at stability diagrams in scalar equations and 
move into the study of bifurcations as it naturally arises while looking at stability. 
Bifurcation occurs when the dynamics abruptly change as certain parameters move 
across certain values. We end Chapter 6 by considering stable and unstable man- 
ifolds, which then delves into the Hartman—Grobman theorem. The theorem says 
that the behavior of a dynamical system in the domain near a hyperbolic equilibrium 
point is qualitatively the same as the behavior of its linearization near this equilibrium 
point, where hyperbolicity means that no eigenvalue of the linearization has a zero 
real part. 


Chapter 7 delves deeply into the stability of general systems using Lyapunov 
functions. We prove general theorems regarding the stability of autonomous and non- 
autonomous systems by assuming the existence of such Lyapunov function. We touch 
on the notion of w-limit set and its correlation to Lyapunov functions. The chapter is 
concluded with a detailed discussion on exponential stability. 


Chapter 8 is solely devoted to the study of delay differential equations. It con- 
tains recent development in the research of delay differential equations. We begin 
the chapter by pointing out how basic results from ordinary differential equations 
are easily extended to delay differential equations. We introduce the method of steps 
and show how to piece together a solution. The transition of moving from ordinary 
differential equations to delay differential equations was made simple through the 
extension of Lyapunov functions to Lyapunov functionals. Then we move on to 
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a whole new concept, fixed point theory. The use of fixed point theory alleviates 
some of the difficulties that arise from the use of Lyapunov functionals when study- 
ing stability. Later on, we apply fixed point theory to the study of stability and the 
existence of positive periodic solutions of neutral differential equations and neutral 
Volterra integro-differential equations, respectively. We end the chapter with the use 
of Lyapunov functionals to obtain necessary conditions for the exponential stability 
of Volterra integro-differential equations with finite delay. 


Chapter 9 deals with current research concerning the use of a new variation of 
parameters formula. The objective is to introduce a new method for inverting first- 
order ordinary differential equations with time-delay terms to obtain a new variation 
of parameters formula that we use to study the stability, boundedness, and periodicity 
of general equations in ordinary and delay differential equations. 


A combination of Chapters |—3, 6, and 7 can be used to deliver a course on non- 
linear systems for engineers. 


The author has not attempted to give the historical origin of the theory, except 
in very rare cases. This resulted in the situation that not every reference listed in 
References is mentioned in the text or the body of the book. 


Exercises play an essential learning tool of the course and accompany each chap- 
ter. They range from routine calculations to solving more difficult problems to open- 
ended ones. Students must read the relevant material before attempting to do the 
exercises. 


I am indebted to Dr. Mohamed Aburakhis, who fully developed all the codes 
for all the figures in the book. I like to thank the hundreds of graduate students 
at the University of Dayton whom the author taught for the last 20 years and who 
helped the polishing and refining of the lecture notes, most of which have become 
this book. 


A heartfelt appreciation to Jeff Hemmelgarn from the University of Dayton for 
carefully reading the whole book and pointing out many typos. 


Youssef N. Raffoul 
University of Dayton 
Dayton, Ohio 

June 2021 
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CHAPTER 


Preliminaries and Banach 
Spaces 


We briefly discuss basic topics of ordinary differential equations and provide exam- 
ples that illustrate the need for a comprehensive and systematic theory of differential 
equations. In addition, we introduce metrics and Banach spaces, which we will use 
throughout the book. 


1.1 Preliminaries 


Let R denote the set of real numbers, let J be an interval in R, and consider a function 
x:I— R. We say the function x has a derivative at a point ¢* € J if the limit 


x(t) — x(t*) 


tel,t>rm t—t* 
exists as a finite number. In this case, we adopt the notation 


. x(t) — x(t* 
x(t*) = lim i aa ) 

tel, t>1* t —t* 
where x’(t*) is the instantaneous rate of change of the function x at t*. If t* is one of 
the endpoints of the interval 7, then the above definition of derivative becomes that 
of a one-sided derivative. If x’(t*) exists at every point t* € J, then we say that x is 


d 
differentiable on J and write x’(t). Throughout the book, we might use — to indicate 


x'(t). Similarly, if x’(t) has a derivative function, then we call it the second derivative 
of the function x(t) and denote it by x” (t). For higher-order derivatives, we use the 
notations 


n 


dt" 


The order of a differential equation is defined by the highest derivative present in the 
equation. An nth-order ordinary differential equation is a functional relation of the 
form 


x(t), xP), ...,x, or 


dx d*x dx d"x 
dt’ dt?’ dt3’""” dt" 
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between the independent variable t and the dependent variable x, and its derivatives 


dx d*x d°x d"x 
dt’ dt?’ dt?’ dt’ 


Loosely speaking, by a solution of (1.1.1) on an interval J, we mean a function x(t) = 
y(t) such that 


F(t, g(t), 90), .-.,e@@) 
is defined for all t € J and 


F(t, g(t), 9'(0),...,9°()) =0 


for all t € I. If we require, for some initial time fo € R, a solution x(t) to satisfy the 
initial conditions 


n—-ly 


Want 0) = 4n-1, (1.1.2) 


5. OS 
x(to) = dag, — =a, — 1 
0 0 7, Wo ly 72 Yo 2 
for constants a;,i = 0,1,2,...,2—1, then (1.1.1) along with (1.1.2) is called an initial 
value problem (IVP). 

Following the notation of (1.1.1), a first-order differential equation takes the form 


: dx 
Hence, if we assume that we can solve for —, then we have 


x'(t)= f (t,x) 


for some function f that satisfies certain continuity conditions. 
Let x: J > R be a function. A differentiable function z: J — R is called an 
antiderivative of the function x on the interval / if 


z(t) =x(t) forall t eT. 


The set of all antiderivatives of x is denoted by 


[war 


and called the indefinite integral of the function x. When we calculate the indefi- 
nite integral [ t?dt, we in fact solve the first-order differential equation x’(t) = t?. 
The family of its solutions is given by t°/3 + c, where c is any constant. Thus we 
may write the solution as x(t) = t?/3 + c, which is a one-parameter family of so- 
lutions, the same as the family of all the antiderivatives of t*. Now, if we impose 
an initial condition on the differential equation, say x (fo) = xo, for some initial time 
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1.1 Preliminaries 3 


to and real number xg, then the constant c is uniquely determined by the relation 
xo = i, /3 +c. In this case the differential equation has the unique solution given by 
x(t) = 3/3 +x0 — te /3. However, without imposing the condition x(fo) = xo, the 
differential equation would have infinitely many solutions given by x(t) = 1?/3 +c. 

Differential equations play an important role in modeling the behavior of physical 
systems such as falling bodies, vibration of a mass on a spring, and swinging pen- 
dulum. To illustrate the need for the theoretical study of differential equations and in 
particular nonlinear ones, we examine a few examples. 

Consider the first-order differential equation 


x'(t) =A(t)g(x), x(t) = x0, t= bo, 


where h, g : R > R are continuous. 


1. If g(xo) = 0, then x(t) = xo is a solution. 
2. Ina region where g(x) 4 0, we can divide by g(x) so that 


x'(t) 
=h(t). 
gem 


Separating the variables and then integrating both sides from fo to f give 


’ x'(s)ds [ 
— h(s)ds. 
[ coy 


Using the transformation u = x(s) with x (to) = xo, we arrive at 


x(t) 
i oi [ h(s)ds. 
xO g(u) to 


dG 1 
If for some function G, we have aa then the above expression implies that 
x  &§ 


t 
Gon) — Geo) = | h(s)ds 


10 
or 
t 
xO=6" (G(x) + / n(s)ds), 
to 
provided that the inverse of G exists. Note that the right side of the above expres- 
sion depends on the initial time fo and the initial value x9. Therefore to emphasize 


the dependence of solutions on the initial data, we may write a solution x(t) in 
the form x(t) = x(t, fo, xo). 
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FIGURE 1.1 


This example shows infinitely many solutions. 


In the next example, we illustrate the existence of more than one solution. Consider 
the differential equation 


x'(th= S80, x(0)=0, teR. 


It is clear that x(t) = 0 is a solution. Hence we may consider a solution x; (t) = 0 and 


let 
0 fort <0, 
as | e/2 fort >0, 
which is also a continuous and differentiable solution. Likewise, for t; > 0, we have 
0 fort <t, 
as | (t—1)7/? fort >t. 


Continuing in this way, we see that the differential equation has infinitely many solu- 
tions. Similarly, if x is a solution, then —x is also a solution (see Fig. 1.1). 

In the next example, we show that solutions may escape (become unbounded) in 
finite time. The differential equation 


x(t) =x°(t), x(to) =x0 > 0, t> 10 
has the solution 


1 


ae Sk pt). 
Xo 
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ee 1 
We can easily see that the solution is only valid for t < f9 + —; and becomes un- 
2x65 
1 
2x¢ 
The most important application in engineering problems is Newton’s law 


bounded (escapes) as t approaches fo + from the left. 


2 
a?x(t) _ fae. dx(t) 


ve dt? dt 


] 


for the position x(t) of a particle with mass m acted on by a force F’, which may be 


a function to time ¢, the position x(t), and the velocity a For example, if the force 


is only due to gravity, then we have the second-order differential equation 


d?x(t) 
ae 


which has the solution 
I 4 
x(t) = Sgt? tert ten, 


where c; and cz are constants that can be uniquely determined by specifying the 
position and velocity of the particle at some instant of time. 
In the next example, we consider the problem of leaky bucket. 


Example 1.1. We have a bucket with no water flowing into it and having a hole in the 
bottom. If Q is the volumetric flow rate, then Qin — Qout = Qstored. Since Qin = 0, 
we obtain QOstored = — Qout. Let h(t) be the height of the water in the bucket at time f, 
and assume that the initial height at time t = 0 is ho. Let v(t) be the velocity of 
the leaked water (flow velocity). The volumetric flow rate Qstoreq can be calculated 
by multiplying the velocity by the area of the bucket, that is, Qstoreq = Apucket 2. 
Similarly, Q out is the flow velocity multiplied by the area of the hole Apole. It follows 
that Qout = Anolev(t). For fluids of height h(t), the velocity of water coming out at 
the bottom is v(t) = ./2gh(f). By rearranging the terms, we arrive at the first-order 


differential equation in h given by 


aw =—kJ/h, h(0) =ho, (1.1.3) 


A 
where k = ey 2g > 0. By separating the variables in (1.1.3) and then integrat- 
bucket 
ing, we arrive ‘at the solution 


Mie (Vio - aay (1.1.4) 


2 


Note that the solution h(t) given by (1.1.4) decreases from the initial height hy. More- 
over, at time f* = ahi the water is completely drained (by gravity), h(t*) = 0, and 
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the bucket will remain empty or the height will remain zero after t* = pula There- 
fore we may write the solution as 


h(t, 0, ho) = 


0, po Sah. 


Another interesting application is the projectile problem that we analyze in the 
next section. 


1.2 Escape velocity 


Let M and R be the mass and radius of the Earth, respectively. We are interested 
in finding the smallest initial velocity for a mass m to exit the Earth’s gravitational 
field, the so-called escape velocity. We assume that no external forces are acting on 
the system other than the gravitational force. Newton’s universal gravitational law 
states that the force between two massive bodies is proportional to the product of the 
masses and inversely proportional to the square of the distance between them, where 
the mass of each body can be considered as concentrated at its center. For a mass m 
with position x above the surface of the Earth, the force F on the mass is given by 


Mm 
(R+x)?’ 


where G is the proportionality constant in the universal gravitational law. The mi- 
nus sign means the force on the mass m points in the direction of decreasing x. By 


Newton’s second law, force F = m£* ai + (mass times acceleration). When x = 0, that 
is, at the Earth’s surface, the gravitational force equals —mg, where g is the gravita- 
tional constant. Therefore 


GM 


Rp =e g~9.8m/s’. 


We have the second-order differential equation 


d?x M 
=-G 
dt? (R+x)? 
& 
= -a are ate (1.2.1) 


where the radius of the Earth is known to be R © 6350 km. We transform Eq. . = 1) 
na a first-order differential equation in terms of the velocity v by noting that 4 i ——— 
a. If we write v(t) = v(x(t)), that is, considering the velocity of the mass m as a 
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function of its distance above the Earth. Then using the chain rule, we have 


dv = dv dx 

dt dxdt 
dv 
=vU—, 
dx 


since v = a As a consequence, (1.2.1) becomes the first-order differential equation 


dv g 1 


dx (1+ 4)? vu 


Suppose the mass is shot vertically from the Earth’s surface with initial velocity 
u(x = 0) = vo. Separating the variables and integrating both sides, we obtain 


dx 
[rv=-s| aoa 


v2 gR? n 
aes c 
2 R+x 


for some constant c. Using the initial velocity condition, we find 


which gives 


2 
vu 
c=—gR+ a 


Substituting c back into the solution and simplifying, we arrive at the solution 


Rx 
wap 8 


v : 
" R+x 


The escape velocity is defined as the minimum initial velocity vp, such that the mass 
can escape to infinity. Therefore vp = Vescape When v — 0 as x — oo. Taking the 
limit, we have 

gRx 


Sse : awd, 
C= og oER 


or 


2 _— 
Vescape = 


2gR. 


With R © 6350 km and g = 127,008 km/h’, we get Vescape = /2gR © 40,000 km/h. 
In contrast, the muzzle velocity of a modern high-performance rifle is 4300 km/h, 
which is not enough for a bullet shot into the sky to escape from Earth’s gravity. 


Now we formally attempt to qualitatively analyze differential equations. 
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Definition 1.2.1. Let D be an open subset of R?, and let f : D > R be a continuous 
function. Let (to, x9) € D. We say that x(t) = x(f, fo, xo) is a solution of 


x’ = f(t,x), x(t) = x0, (1.2.2) 


on an interval J if t9 €¢ J, x : 1 > R is differentiable, (t, x(t)) € D fort € J, x’(t) = 
f(t, x(t) fort € 7, and x(to) = xo. 


Definition 1.2.2. A solution x(t) of (1.2.2) is said to be bounded on the interval 
I = [0, o0) if for any fo € [0, 00) and r > 0, there exists a positive number a(to, r) 
depending on fp and r such that |x(f, fo, xo)| < a(to, r) for all t > f and xo such that 
|xo| <r. Itis uniformly bounded if a is independent of the initial time fo. 


Definition 1.2.3. Let x(t) and y(t) be solutions of (1.2.2) with respect to initial 
conditions xg and yo, respectively. The solution x(t) is then said to be stable if for 
every € > 0, there exists 6 = 6(é, fg) > O such that 


|x(t) — y(t)| < € whenever |xo — yo| <6. 
Consider the linear differential equation 
x'(t)=1, x(to) = x0. (1.2.3) 


It is easy to check that x(t) = xo + (¢ — fo) is the solution of (1.2.3). If y(t) is another 
solution with y(to) = yo, then we have y(t) = yo + (tf — fo). For any ¢ > 0, letd =e. 
Then 


|x(t) — y(t)| = |xo + (¢ — fo) — yo — (¢ — t0)| = |xo — yo| <€ 


whenever |x9 — yo| < 6. Hence the solution x(t) is stable but clearly unbounded. 
This simple example shows that the notion of a solution being unbounded does not 
automatically imply that the same solution is unstable with respect to another solution 
starting at a different initial point. In Chapters 6 and 7 we will discuss boundedness 
and stability in more detail. The previous examples illustrate the need for a coherent 
theory for addressing the following issues: 


1. Existence and uniqueness. 
2. Boundedness and stability. 
3. The dependence of solutions on the initial data. 


1.3 Applications to epidemics 

The law of mass action is a useful concept that describes the behavior of a system 
that consists of many interacting parts, such as molecules, that react with each other, 
or viruses that are passed along from a population of infected individuals to non- 
immune ones. The law of mass action was first derived for chemical systems but 
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subsequently found wide use in epidemiology and ecology. To describe the law of 
mass action, we assume that m substances 51, 52,..., 5m together form a product 
with concentration p. Then the law of mass action states that - is proportional to 
the product of the m concentrations s;, i = 1,...,m, that is, 


d 
= =ks1s2...S8m.- 


dt 


Suppose we have a homogeneous population of fixed size divided into two groups. 
Those who have the disease are called infective, and those who do not have the dis- 
ease are called susceptible. Let S = S(t) be the susceptible portion of the population, 
and let J = I(t) be the infective portion. Then by assumption, we may normalize the 
population and have $+ J = 1. We further assume that the dynamics of this epidemic 
satisfies the law of mass action. Hence, for positive constant A, we have the nonlinear 
differential equation 


I'(t)=ASI. (1.3.1) 

Let 7(0) = Ip, 0 < I(0) < 1, be a given initial condition. By substituting § = 1 — J 
into (1.3.1) it follows that 

I'(t)=Al(Ql—1), 10) =h. (1.3.2) 

If we can solve (1.3.2) for /(t), then S(t) can be found from the relation J + S$ = 1. 


We separate the variables in (1.3.2) and obtain 


dI 


a 
7S 


Using partial fraction on the left side of the equation and then integrating both sides 
yield 


Ln|/| — Ln|l — 7| =Att+c, 
or for positive constant c;, we have 


At 


ce 
I(t) = ————.. 
@ 1+ cyer# 
Applying I (0) = J gives the solution 
(a (1.3.3) 
~ T= Ip + Ipe*’ _ 


Now for 0 < 7(0) < 1, the solution given by (1.3.3) is increasing with time as ex- 
pected. Moreover, using L’ Hospital’s rule, we have 


Ipe* 


lim 1(t) = lim ——°"——_ = 1 
t>0o t>oo | — Io + Ipe*# 
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Hence the infection will grow, and everyone in the population will eventually get 
infected. 


1.4 Metrics and Banach spaces 


This section is devoted to introductory materials related to Cauchy sequences, metric 
spaces, contraction, compactness, contraction mapping principle, and Banach spaces. 
Materials in this section will be of use in several places of the book, especially in 
Chapters 2, 8, and 9. Throughout the book, by C(/, R”), we denote the space of all 
continuous functions f : J > R” on an interval J, possibly infinite. 


Definition 1.4.1. A pair (EZ, o) is a metric space if E isaset and op: E x E > [0, oo) 
such that for all y, z, and uw in E, we have 


(a) p(y, z) = 9, p(y, y) =9, and p(y, z) =0 implies y = z; 
(b) p(y, z) = e(z, y); and 
(c) p(y,z) < p(y,u)+ plu, z). 


The next definition is concerned with Cauchy sequences. 


Definition 1.4.2. (Cauchy sequence) A sequence {x,} C E is a Cauchy sequence if 
for each ¢ > 0, there exists N € N such thatn,m > N = > e(X%y,Xm) < €&. 


Complete metric spaces play a major role when showing that a fixed point belongs 
to the metric space of interest. 


Definition 1.4.3. (Completeness of metric space) A metric space (E, p) is said to be 
complete if every Cauchy sequence in F converges to a point in E. 


Definition 1.4.4. A set L in a metric space (E, ) is compact if each sequence in L 
has a subsequence with a limit in L. 


Definition 1.4.5. Let { f;,} be a sequence of real functions with f, : [a,b] > R. 


1. {f,} is uniformly bounded on [a, b] if there exists M > 0 such that | f,(t)| < M 
for alln € N and t € [a, D]. 

2. {fn} is equicontinuous at fo if for each ¢ > 0, there exists 5 > 0 such that for 
alln EN, if t € [a,b] and |to — t| < 6, then | fi, (to) — fr(t)| < e. Also, {f,} is 
equicontinuous if { f;,} is equicontinuous at each fo € [a, b]. 

3. {f,} is uniformly equicontinuous if for each ¢ > 0, there exists 6 > 0 such that for 
alln EN, if t1, t2 € [a, b] and |t; — fo| < 4, then | f(t) — fu(t2)| <e. 


It is easy to see that { f,} = {x”} is not an equicontinuous sequence of functions 
on [0, 1] but each f,, is uniformly continuous. 


Proposition 1.1. [Cauchy criterion for uniform convergence] If {Fn} is a sequence 
of bounded functions that is Cauchy in the uniform norm, then {F,} converges uni- 
formly. 
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Definition 1.4.6. A real-valued function f defined on E C R is said to be Lipschitz 
continuous with Lipschitz constant K if | f(x) — f(y)| < K|x — y| forallx, ye E. 


It is easy to see that the function f(x) = x? is not Lipschitz on R. This is due to the 
fact that for any x and y in R, we have that f(x) — f(y) = |x* — y*| = |x+yllx— yl, 
and so there is no constant K such that |x* — y*| < K |x — y|. Definition 1.4.6 implies 
that f is globally Lipschitz since the constant K is uniform for all x and y in R. 


Remark 1.1. It is an easy exercise that a Lipschitz continuous function is uniformly 
continuous. Also, if each f, in a sequence of functions { f,} has the same Lipschitz 
constant, then the sequence is uniformly equicontinuous. 


Lemma 1.1. /f { f,} is an equicontinuous sequence of functions on a closed bounded 
interval, then { f,} is uniformly equicontinuous. 


Proof. Suppose {f,} is equicontinuous on [a,b]. Let ¢ > 0. For each x € K, let 
5, > 0 be such that |y — x] <6, = > |fir(®) — faQ)| < €/2 for all n e N. The 
collection {B(x, 6,/2) : x € [a,b]} is an open cover of [a,b], so it has a finite 
subcover {B(x;, 5x;/2) :i = 1,...,k}. Let 6 = min{d,,/2:7 = 1,...,k}. Then, if 
x,y € [a,b] with |x — y| < 6, then there is some i with x € B(xj, 6x,;/2). Since 
|x — yl <8 < 5y,/2, we have |x; — y| < [xi — x] + |x — yl < bx, /2 + 54/2 = by. 
Hence |x; — y| < 4x, and |x; —x| < 5,,. So, for any n € N, we have | fn (x) — fr(y)| < 
| fn) — fulai)| + | fn Qi) — faQ)| < €/2 + €/2 = 8. So { fn} is uniformly equicon- 
tinuous. 


The next theorem gives us the main method of proving compactness in the spaces 
we are interested in. 


Theorem 1.4.1. [Ascoli-Arzela] If { f,(t)} is a uniformly bounded and equicontin- 
uous sequence of real-valued functions on an interval [a, b], then there is a subse- 
quence that converges uniformly on [a, b] to a continuous function. 


Proof. Since {f,(t)} is equicontinuous on [a, b], by Lemma (1.1) {f,(t)} is uni- 
formly equicontinuous. Let f), f2,... be a listing of the rational numbers in [a, b] 
(note that the set of rational numbers is countable, so this enumeration is possi- 
ble). The sequence { f, (aye , is a bounded sequence of real numbers (since { fy} 
is uniformly bounded), so it has a subsequence { fy, (¢1)} converging to a num- 
ber, which we denote ¢(f,). It will be more convenient to represent this subse- 
quence without subsubscripts, so we write - for fn, and switch the index from 
k ton. So the subsequence is written as if (ha: Now, the sequence {ft (t2)} is 
bounded, so it has a convergent subsequence, say { i (t2)}, with limit @ (t2). We con- 
tinue in this way obtaining a sequence of sequences { f/”(t)}"° , (one sequence for 
each m), each of which is a subsequence of the previous one. Furthermore, we have 
Fi" (tn) > (tm) as n — oo for each m € N. Now, consider the “diagonal” functions 
defined F(t) = i (t). Since fi" (tn) > O(tm), it follows that F;(tm) > (tn) as 
r — oo for each m € N (in other words, the sequence { F,(t)} converges pointwise at 
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each t,,). We now show that {F;(t)} converges uniformly on [a, b] by showing that 
it is Cauchy in the uniform norm. Let ¢ > 0, and let 5 > 0 be as in the definition of 
uniformly equicontinuous for { f;, (¢)} applied with ¢/3. Divide [a, b] into p intervals, 
where p > bea Let §; be a rational number in the jth interval for j = 1,..., p. Re- 
call that {F;(t)} converges at each of the points &;, since they are rational numbers. 
So, for each j, there is M; € N such that | F,(&;) — Fs(&;)| < ¢/3 whenever r,s > Mj. 
Let M=max{M;:j =1,..., p}.Ift € [a, b], then it is in one of the p intervals, say 
the jth. So |t — | < 6, and thus | f7() — f7(€)| =|F-O — F-(&;)| < €/3 for ev- 
ery r. Also, if r,s > M, then |F,(&;) — Fs(&j)| < €/3 (since M is the maximum of 
the M;). So for r,s > M, we have 


|F-(t) — Fs)| = |F-() — Fr (Ej) + Fr Ej) — Fs (6j) + Fs (Ej) — Fs 
<1F-O- FEp)lt+ lA Ep) — spl + Fs Ep) — Fs 


LAS a ear ate 
ca ae: ee 


By the Cauchy criterion for convergence, the sequence { F;(t)} converges uniformly 
on [a,b]. Since each F;(t) is continuous, the limit function @(t) is also continu- 
ous. 


Remark 1.2. The Ascoli—Arzela theorem can be generalized to a sequence of func- 
tions from [a,b] to R”. Apply the Ascoli—Arzela theorem to the first coordinate 
function to get a uniformly convergent subsequence. Then apply the theorem again, 
this time to the corresponding subsequence of functions restricted to the second co- 
ordinate, getting a subsubsequence, and so on. 


The next criterion, known as the Weierstrass M-test plays an important role in 
showing the existence of solutions. 


Lemma 1.2. (Weierstrass M-test) Let {fn} be a sequence of functions defined on a 
set E. Suppose that for alln =1,..., there is a constant M,, such that | f,(t)| < Mn 
for allt € E. If 


lee) lee) 
S> Mn <00, then SRO 
n=1 n=1 


converges absolutely and uniformly on the E. 


We remark that the Weierstrass M-test can be easily generalized if the domain of 
the sequence of functions is a subset of Banach space endowed with an appropriate 
norm. 

Here is an example of the Weierstrass M-test. 


Example 1.2. For n = 1,2,..., define the sequence of functions {f,} on R by 
fn(t) = - Then | fn (¢)| = | 


1 
Pant < 53 = Mp forall t € Randn > 1. Since 


t2 +n? 
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1 
the series ie 7”) converges, by the Weierstrass M-test the series > Ie) con- 
n 
n=1 
verges uniformly on R. Moreover, as each term of the series is SenuHuoils and the 
convergence is uniform, the sum function is also continuous. (As the uniform limit 


of continuous functions is continuous.) 
Here is another example with a simple twist to it. 
Example 1.3. We prove that the series 
Sn? oe 
nt + x2 
n=1 


converges to a continuous function f:R— R. 
Let c be a positive constant. Then for all x € [—c, c], we have that 
n? + x4 n? + x4 1 ct 


= <344+4:=™. 
| 44 x2 nt Py ae 


On the other hand, the series 
CO [oe Cc 
1 4 1 
2 Ms ee ae ar 


converges, so Weierstrass M-test implies that the series converges uniformly to 
a function f on the bounded interval [—c, c]. Each term in the series is continuous 
and since the uniform limit of continuous functions is continuous, the limit func- 
tion f is continuous on [—c, c] for every c > 0. Now since every x € R lies in such 
an interval for sufficiently large c, it follows that f is continuous on R. Note that the 
series does not converge uniformly on R, so we cannot use the argument that the sum 
is continuous on R because the series converges uniformly on R. 


Banach spaces form an important class of metric spaces. We now define Banach 
spaces in several steps. 


Definition 1.4.7. A triple (V,+,-) is said to be a linear (or vector) space over 
a field F if V is a set and the following are true. 


1. Properties of + 

a. + isa function from V x V to V. Outputs are denoted x + y. 

b. forallx,yeV,x+y=y+x (+ is commutative). 

c. forallx,y,weV,x+(yvt+w)=(%+y)+ w (+ is associative). 

d. there is a unique element of V, which we denote 0, such that for all x € V, 
O+x=x+0=x (additive identity). 

e. for each x € V, there is a unique element of V, which we denote —x, such 
that x + (—x) = —x + x = 0 (additive inverse). 
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2. Scalar multiplication 
a. -isafunction from F x V to V. Outputs are denoted @ - x or ax. 
b. foralla, 6B € F andx € V, a(Bx) = (a@B)x. 
c. forallxe V,1l-x=x. 
d. foralla,B ee F andx eV, (a+ B)x =ax + Bx. 
e. forallac Fandx,yeV,aix+y)=ax+ay. 


Commonly, the real numbers and complex numbers are fields in the above defini- 
tion. For our purposes, we only consider the field of real numbers F = R. 


Definition 1.4.8. (Normed spaces) A vector space (V, +, -) is anormed space if for 
each x € V, there is a nonnegative real number ||x||, called the norm of x, such that 
for allx, ye V andaeR, 


1. ||x|| =0 if and only if x =0, 

2. |lax|] = lol |lxll, 

3. lx + yll < lx + lly. 

Remark 1.3. A norm ona vector space always defines a metric p(x, y) = ||x — y|| on 


the vector space. Given a metric p defined on a vector space, it is tempting to define 
|v|| = e(v, 0). But this is not always a norm. 


Definition 1.4.9. A Banach space is a complete normed vector space, that is, a vector 
space (X,+,-) with norm || - || for which the metric p(x, y) = ||x — y|| is complete. 


Example 1.4. The space (R”, +, -) over the field R is a vector space (with the usual 
vector addition + and scalar multiplication -), and there are many suitable norms for 


it. For example, if x = (x1, x2,..., Xn), then 
1. ||x|| = max |x;|, 
l<i<n 


n 


4. |Ix\lp = (Soa) ped 


are all suitable norms. Norm 2 is the Euclidean norm: the norm of a vector is its 
Euclidean distance to the zero vector, and the metric defined from this norm is the 
usual Euclidean metric. Norm 3 generates the “taxi-cab” metric on R?, and Norm 4 
is the 7? norm. 

Throughout the book, it should cause no confusion to use | - | instead of || - || to 
denote a particular norm. 


Remark 1.4. Consider the vector space (R”, +, -) as a metric space with its metric 
defined by p(x, y) = ||x — y||, where || - || is any of the norms in Example 1.4. The 


Copyright Elsevier 2022 


TT CCCCC“(!LUUUOCtsé(‘(#UUUOti‘(U.UUtéi(#(a(UiCa=ooo 


1.4 Metrics and Banach spaces 15 


completeness of this metric space comes directly from the completeness of R, and 
hence (R”, || - ||) is a Banach space. 


Remark 1.5. In the Euclidean space R”, compactness is equivalent to closedness 
and boundedness (Heine—Borel theorem). In fact, the metrics generated from any of 
the norms in Example 1.4 are equivalent in the sense that they generate the same 
topologies. Moreover, compactness is equivalent to closedness and boundedness in 
each of those metrics. 


Example 1.5. Let C([a,b],R”) denote the space of all continuous functions 
f : [a,b] > R”. 


1. C({a, b], R”) is a vector space over R. 
2. If || fll = max | f(), where | - | is a norm on R”, then (C([a, b], R”), || - ||) is 
axt< 


a Banach space. 
3. Let M and K be two positive constants and define 


L={fe€C(la,b],R"): fll < Ms |fW — f@)| < Klu— vj}. 
Then L is compact. 


Proof (of part 3). Let {f,} be any sequence in L. The functions are uniformly 
bounded by M and have the same Lipschitz constant, K. So the sequence is uni- 
formly equicontinuous. By the Ascoli—Arzela theorem there is a subsequence { fn, } 
that converges uniformly to a continuous function f : [a, b] > R”. We now show that 
f €L. Well, | fn(t)| < M for each t € [a, b], so | f(t)| < M for each t € [a, b] and 
hence || f|| < M. Now fix u,v € [a, b] and ¢ > 0. Since { f,, } converges uniformly 
to f, there is N € N such that | f,, (tf) — f()| < €/2 for all t € [a, b] and k > N. So 
fixing any k > N, we have 


If) — FO =1FO — fr + fa) — fr) + fr) — FO)| 
SIL) = fry WO + | fing WO) = Sry | + | fry ) — FO) 
<eé/2+Klu—v|+e/2=K|u—v|+¢. 
Since ¢ > 0 was arbitrary, | f(u) — f(v)| < K|u—v|. Hence f € L. We have demon- 


strated that {f,,} has a subsequence converging to an element of L. Hence L is 
compact. 


Example 1.6. Consider R as a vector space over R and define the metric d(x, y) = 
|x — yl 
1+|x— y| 
norm on R. 


. For each x € R, we define ||x|| = d(x, 0). Explain why || - || is not a 


Example 1.7. Let @ : [a,b] > R” be continuous, and let S be the set of continuous 

functions f : [a,c] > R” withc > band f(t) = ¢(f) fora <t < b. Define p(f, g) = 

lf—gll= sup |f()—g(@| for f, g ¢ S. Then (S, e) is a complete metric space 
ast<c< 


but not a Banach space since f + g is notin S. 
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Example 1.8. Let (S, 0) be the space of continuous bounded functions f : (—oo, 0] > 
R with p(f.g)=|If —gll= sup |f(@) — g@)|. Then: 
—oo<t<0 
1. (S, e) is a Banach space. 
2. The set L={feS:|| fll <1,|f@f)| < |u— v]} is not compact in (S, p). 


Proof (of 2). Consider the sequence of functions defined 


if t < —n, 


fr(t) = 


£41 if-n<t<0. 


Then the sequence converges pointwise to f = 1, but p(f,, f) = 1 for alln EN. 
So there is no subsequence of { f,} converging in the norm || - || (i.e., converging 
uniformly) to f. 


Example 1.9. Let (S, e) be the space of continuous functions f : (—oco, 0] > R” 
with 


Of. 8)= > 2 onl Ff. 8/1 + pal f 8}, 


n=1 


where 
Pn(f, 8) = max | f(s) — g(s)|, 
—n<s<0 
and | - | is the Euclidean norm on R”. Then: 


1. (S, o) is a complete metric space. The distance between all functions is bounded 
by 1. 

2. (S,+,-) is a vector space over R. 

3. (S, e) is not a Banach space because p does not define a norm, since p(x, 0) = 
||x|| does not satisfy ||@x || = |a|||x||. 

4. Let M and K be given positive constants. Then the set 


L={feS:||f\| <M on (—oo, 0], |f(u) — f(v)| < K|u— vj} 
is compact in (S, ~). 


Proof (of 4). Let {f,} be a sequence in L. It is clear that if f, — f uniformly on 
compact subsets of (—oo, 0], then we have p(fn, f) > 0 as n —> ow. Let us be- 
gin by considering {f,,} on [—1,0]. Then the sequence is uniformly bounded and 
equicontinuous, and so there is a subsequence, say { Fi, converging uniformly to 
some continuous f on [—1, 0]. Moreover, the argument of Example 1.5 shows that 
|f@ |< M and |f(@) — f(v)| < Ku — v|. Next, we consider {fF} on [—2, 0]. 
Then the sequence is uniformly bounded and equicontinuous, and so there is a sub- 
sequence, say { ind ® converging uniformly, say, to some continuous f on [—2, O]. 
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Continuing this way, we arrive at F;,, = f,”, which has a subsequence of { f,,} con- 
verging uniformly on compact subsets of (—oo, 0] to a function f € L. This proves 
that L is compact. 


We leave the proof of next result to the reader. 


Theorem 1.4.2. Let g : (—0o, 0] = [1, 00) be a continuous strictly decreasing func- 
tion with g(0) = 1 and g(r) > co as r > —ov. Let (S,| + |g) be the space of 
continuous functions f : (—oo, 0] > R” for which 


If@| 


ee lg(t)| 


Iflg = 


exists. Then: 


1. (S,|-|¢) is a Banach space. 
2. Let M and K be given positive constants. Then the set 


L={feS:||f\| <M on(—oo,0],|f@ — f(v)| < Klu— vj} 
is compact in (S, p). 


Definition 1.4.10. Let (E, o) be a metric space, and let D: E — E. The operator or 
mapping D is a contraction if there exists a € (0, 1) such that 


p(D@), DO)) <ap(x, y). 


The next theorem is known by the name of Caccioppoli theorem, or the Banach 
contraction mapping principle [9]. A proof can be found in many places, such as 
Burton [15] or Smart [58]. 


Theorem 1.4.3. (Contraction mapping principle) Let (E, p) be a complete metric 
space, and let D: E — E be a contraction operator. Then there exists a unique 
@ € E such that D(¢) = ¢. Moreover, if w € E and if {Wy} is defined inductively by 
Ww, = DW) and Wy41 = Dy), then bp > ¢, the unique fixed point. 


Proof. Let yo € E and define the sequence {y,} in E by yy = Dyo, y2 = Dy, = 
D(Dyo) = D7 yo, .-+) Yn = Dyn, = D" yo. Next, we show that {y,} is a Cauchy 
sequence. Indeed, if m > n, then 


P(Yns Ym) = p(D" yo, D”™ yo) 
<ap(D"~! yo, D™ yo) 


= a” (yo, Yn—1) 
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<a" {o(yo, v1) + 001, Y2) +... + POm—n—15 Ym—n)} 
<a"{p(yo, v1) + ap(y0, 1) +. Fa" p(yo, Y)} 
<a"p(yo, y{lLta+...¢0"" 1} 


<a" p(yo, y1) : 
l-a 


Thus, since a € (0, 1), we have that 


P(Yn, Yn) > Oasn— oo. 


This shows that the sequence {y,} is Cauchy. Since (EZ, p) is acomplete metric space, 
{Yn} has a limit, say y in E. Since the mapping D is continuous, we have that 


D(y) = DCm yn) = lim Dn) = lim ynst =, 
noo noo n—>oo 


and y is a fixed point. It remains to show that y is unique. Let x, y € E be such that 
D(x) =x and D(y) = y. Then 


which implies that 


0 < p(x, y) =p(D@), DY)) < ap(x, y), 


O0<(1-a@)p(x, y) <0. 


Since | — a £0, we must have p(x, y) = 0, and hence x = y. This completes the 


proof. 


Another form of the contraction mapping principle: 


Theorem 1.4.4. (Contraction mapping principle, Banach fixed point theorem) Let 
(E, p) be a complete metric space, and let P : E + E be such that P™ is a con- 
traction for some fixed positive integer m. Then there is a unique x € E such that 


P(x) =x. 


1.5 Variation of parameters 


In this section we develop the variation of parameters formula, which we use, in one 
form or another, throughout this book. Consider the nonhomogeneous differential 


equation 


x'(t) =a(t)x(t) + g(t, x), x(to.) = x0, t= = 0, (1.5.1) 


where g € C([0, cc) x R, R) anda € C((0, oo), R). 
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Lo a(u)du 


Multiplying both sides of (1.5.1) by the integrating factor e— and observ- 
ing that 
d _ fi _ ft _ pt 
a (« (t)e Lig ae) —x'(t)e Sig a(ujdu _ acne Lis nen. 
we atrive at 


“(x (te 0 ae) ore x(t))e tv a(ujdue 


Integration of the above expression from fo to ¢ and using x(to) = xo yield 


— t t = Ss 
xe 2M ay [a6 ateye foetas, 


1 


from which we get 


t t : 

shane + e(s,x(s)jels (ds, 4> 1 >0. (1.5.2) 
10 

It can be easily shown that if x(t) satisfies (1.5.2), then it satisfies (1.5.1). Expression 

(1.5.2) is known as the variation of parameters formula. Note that (1.5.2) is a func- 

tional equation in x since the integrand is a function of x. If we replace the function 

g with a function h € C([0, oo), R), then (1.5.2) takes the special form 


t t t 
thax +/ h(sjels 44 ds >t >0. (1.5.3) 
10 


Another special form of (1.5.2) is that if the function a(t) is constant for all t > fo 
and g is replaced with h as before, then from (1.5.3), we have that 


t 
x) =x0e— + | e!—Jh(s)ds, t > tp > 0. (1.5.4) 
10) 


It is easy to compute, using (1.5.4), that the differential equation 
x/(t) = 2x(t) +t, x(0) = 3, 


has the solution 

13 t 1 
ger et ee 
4 2 4 


Remark 1.6. The variation of parameters formula given by (1.5.2) is valid for 


x(t) = 


gé€C(RxR,R) and aeC(R,R). 


Next, we consider the following application regarding the variation of parameters. 
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(a) ara Gee 
9 , man 
(b) as 
(e) 
+ 
5 C 


FIGURE 1.2 
RC circuit. 


1.5.1 RC circuit 


Fig. 1.2 shows a resistor R and capacitor C connected in a series. The battery con- 
nected to this circuit by a switch provides an electromotive force, or emf force 7. 
Initially, there is no charge on the capacitor. When the switch is flipped to (a), the 
battery connects, and the capacitor charges. Similarly, when the switch is flipped 
to (b), the battery disconnects, and the capacitor discharges with energy dissipated 
in the resistor. Our aim is to determine the voltage drop across the capacitor during 
charging and discharging. 

We start by observing that the voltage drops across a capacitor Vc and resistor Vr 
are given by 


respectively, where C is the capacitance and R is the resistance. The current i and the 
charge q are related by the relation 


. dq 
i= —. 
dt 


From the first equation, we have 


dVc dq \1_ i 1Vkp 
dt dt'C C CR’ 


which implies that 


dV, 
VeeRo— =. 
dt 
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Kirchhoff’s voltage law states that the emf 7 in any closed loop is equal to the sum 
of the voltage drops in that loop. When the switch is thrown to (a), this gives 


Vat Vo =n. 


Substituting Vr into Vr + Vc = n gives the linear differential equation 


ave 1 1 
Vice en VOU: 
de Re pe © 


An application of the variation of parameters formula gives the solution 


t 
way ped 7 s/RC qs 
c(t)=e ; RC? RY 
or 


Vo(t)=n(1— eFC), 


Thus the voltage starts at zero and rises slowly but exponentially to 7 with character- 
istic time scale given by RC. In other words, 


Vc(t) > n as t > O0. 
Now suppose the switch is thrown to (b). Then by Kirchhoff’s voltage law 
Vret+ Vc =0, 
which results in the differential equation 


BNO cap, Dg eh ah 
dt RG ee = a 


Then the solution during the discharge phase is given by 


Ve(t) = ne /RE, 


and the voltage decays exponentially to zero with the characteristic time scale given 
by RC. 


1.6 Special differential equations 


Next, we consider second-order nonlinear differential equations of the form 
x" = f(t, x, x’), (1.6.1) 


where f(t, x, y) is a function of three variables defined in the region D = {(t, x, y): 


ay <t<a,b) <x <b,c) < y < cp} with f, ae and of continuous in D. Little is 
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known about how to solve (1.6.1) except in certain particular cases. Two interesting 
and useful cases occur when (1.6.1) has one of the following forms: 


F(t, x’, x") =0 (1.6.2) 
or 
F(x, x’,x”") =0. (1.6.3) 


For (1.6.2), the transformation x’ = u transforms the original second-order differ- 
ential equation into a first-order differential equation F(t, u,u’) = 0, which can be 
solved. To see this, we consider the nonlinear second-order differential equation 


tx” +2x/+r=1,t>0. 


For x’ = u, we have the first-order differential equation tu’ + 2u + t = 1. Using the 
variation of parameters formula given by (1.5.2), we arrive at 


Cl 1 ¢ 


p= = 
2 2 3 
for some constant c;. Since x(t) = i u(t)dt, we atrive at the general solution 


t 
~-=+0 


Gop 
i rr se amar 


for some constant cp. 

Equations of the form (1.6.3) can be reduced to first-order equations by the substi- 
tution x’ = u. Eq. (1.6.3) is now replaced by the equivalent system of two differential 
equations 


x’ =u, F(x,u,u')=0. 
By using x as the independent variable we have 


» du dudx du 
x == 


= = Uu. 
dt dx dt dx 


Hence (1.6.3) reduces to the first-order differential equation 


F( a, 
XU Ue =0. 


As an application, we consider the differential equation 
x" +(x’? x +x'x =0, x(0) =0, x/(0) = 1. 


Then, under the mentioned substitution, we have the new first-order differential equa- 
tion 


du 2 
u— +u-x +ux =0 
dx 
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or 


u 
—+xu=-x. 


dx 


By the variation of parameters, we arrive at the solution 


x2 
u=-—l+ce2. 
Using u = —1 when x = 0, we have c = 0. Now using the transformation x’ = u, it 
follows that 
dx 
—=-l. 
dt 


Using x(0) = 0, we arrive at the solution 


x(t) =—-t. 


1.7 Exercises 
Exercise 1.1. Show that the differential equation 


x(t) = 5x80, x(0)=0,teER 

has infinitely many solutions. 
Exercise 1.2. Show that the differential equation 

x(t) =x%(t), x(0)=0,teR 
has infinitely many solutions for a € (0, 1). 
Exercise 1.3. Find the escape time of the solutions for the differential equation 

x(t) =x7(t), x(t) =x0 £0, tER. 

Exercise 1.4. Show that the solution x(t, to, xo) of 

x/(t)=t, x(to.) =x0 40, t>0 
is stable but unbounded. 


Exercise 1.5. Let x = (x1, .x2,...,%n), xj € R,i=1,2,...,n. 
n 


Show that || || = Ss a does not define a norm. 
i=1 
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Exercise 1.6. Consider the following power series L(x), which is also known as 
Euler’s dilogarithm function: 


lee) xn 
L(x) =): 
n=1 


(a) Compute the domain of convergence for L(x). Be sure to give a full analysis of 
the endpoints. 

(b) Show that L(x) uniformly converges on its entire domain of convergence. (Use 
Weierstrass M-test.) 

(c) Explain why the L(x) is continuous on its domain of convergence. 


Exercise 1.7. Consider the sequence { f,} of functions f, : R > R defined by 
nx 
VI+ 2x2 


Find the pointwise limit of this sequence as n — oo. Does the sequence converge 
uniformly on R? 


fn(x) = 


Exercise 1.8. Show that the space C(/, IR), where 7 is any compact subset of R, 
endowed with the supremum norm 


Il flloo = sup | f(t)| 
tel 


is a Banach space. 


Exercise 1.9. Show that the space Qr of all continuous T-periodic functions given 
by 


Qr={f €C(R,R): f(t +T) = f(T) for allt € R} 
with the maximum norm 
= i 
Ifll= max IFO 
is a Banach space. 


Exercise 1.10. Show that the space C([0, 1], R) endowed with the L' norm 


1 
usin =f plat 


is a metric space but is not complete. 


Exercise 1.11. For | < p < ~, let 


Ip = {a= (a1, 42,...): aK ER, ) |axl? < 00} 
k 
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and 
I/p 
Nlallp= (Sola?) 
k 


Show that /, endowed with || - ||» is a Banach space. 
Exercise 1.12. Prove Remark 1.1. 


Exercise 1.13. Find a continuous solution satisfying 
x'(t) + x(t) = f(t), x) =0, 


1, O<t<l, 


0, t>1. 
Is the solution differentiable at t = 1? 


where f(t) = 


Exercise 1.14. Find a continuous solution satisfying 
x(t) + 2tx(t) = f(t), x) = 2, 


t, O<t<l, 


0, t>1. 
Is the solution differentiable at t = 1? 


where f(t) = 


Exercise 1.15. For the SI epidemic model of Section 1.3, use Eq. (1.3.1) and the 
relation J + S = 1 to obtain a first-order differential equation in terms of S and S’. 
Assume a positive condition $(0) = 1 — 7(0) := Spo and find the solution S(t) and 
im sto, 


Exercise 1.16. Let d > 0, and let f : [0, d] > R be continuous. Let k be any constant 
and suppose x(t) solves the differential inequality 


x'(t) <kx(t) + f(t), t € (0, d]. 
Show that 
x(t) <x(O)eK + i ek@—5) F(s)ds, t € [0, d]. 
Hint: There is a continuous and nonnegative function g(t) such that 
x(t) + g(t) =kx(t) + fC, t €[0, d]. 


Exercise 1.17. Suppose a function f : [0,d] x R —> R is continuous and that f(t, x) 
is bounded for all (t, x) € [0, d] x R, where d is a positive constant. Suppose x = g(t) 
solves the differential equation 


x'(th=xf(t,x), x(0)=1, t € [0,d]. 


Show that there is a constant K such that g(t) < eX? for all t € [0, d]. 
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Exercise 1.18. In Problems 1-5 solve the differential equation. If no initial condi- 
tions are given, find the general solution. 


. Px” 4+t=1,t>0. 

. x" + 2tx’=1,t>0. 

» xx" —2(x')? + 4x? = 0, x(1) = 1, x’(1) =2. 
. sin(x’)x” = sin(x), x(1) = 2, x/(1) = 1. 

tx” —x/=Pe',t>0. 


Oo hwWN 
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Existence and 
uniqueness 


In Chapter | we laid out the basics we need to use in this and the following chap- 
ters. This chapter is devoted to the existence and uniqueness and the continuation of 
solutions. We limit our discussions and proofs to scalar differential equations, and in 
Chapter 3 we indicate how the theory can be naturally extended to vector equations. 


2.1 Existence and uniqueness of solutions 


This section is devoted to the existence and uniqueness of solutions of the initial value 
problem (IVP) 


x’ = f(t,x), x(to) =xX0, (2.1.1) 


where we assume that f : D — R is continuous and D is a subset of R x R. In the 
case the differential equation (2.1.1) is linear, a solution can be found. However, in 
general, this approach is not feasible when the differential equation is not linear, and 
hence another approach must be indirectly adopted that establishes the existence of 
a solution of (2.1.1). For the development of the existence theory, we need a broader 
definition of Lipschitz condition. 


Definition 2.1.1. The function f : D — R is said to satisfy the global Lipschitz 
condition in x if there exists a Lipschitz constant k > 0 such that 


If(t,x)-— fl, y)| <klx — y| for @, x), ty) €D. (2.1.2) 


Definition 2.1.2. The function f : D > R is said to satisfy a local Lipschitz con- 
dition in x if for any (t,, x) € D, there exists a domain D; C D such that f(t, x) 
satisfies a Lipschitz condition in x on Dj, that is, there exists a positive constant kj; 
such that 


If(t,x) — f(t, |< Kilx —yl, for (x), @,y) € Di. (2.1.3) 


Definition 2.1.1 can be easily extended to functions f : D— R”, where DC 
IR x R" under a proper norm. Let R = {(t, x): |t} < a, |x| < b} be any rectangle 
in D. If f and 2f are continuous on R, which is the case in this chapter, then f and 


ox 
ar are bounded on R. Therefore there exist positive constants W and .% such that 
af 
lf(@t,x)|<@ and |—|<” (2.1.4) 
Ox 
Advanced Differential Equations. https://doi.org/10.1016/B978-0-32-399280-0.00008-5 2 7 
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for all points (t,x) in R. Now for any two points (t, x1), (¢,x2) in R, by the mean 
value theorem there exists a constant n € (x1, x2) such that 


of 
f(t, x1) — ft, x2) = gy eA — x2), 


from which it follows that 


af 
If, x1) ~ f (t, x2 < lay n)\lx1 ~ x2| 
<2 |x — x2). (2.1.5) 
We have shown that if f and or are continuous on R, then f satisfies a global Lips- 
chitz condition on R. : 


Example 2.1. Consider f (t,x) =x?/? in the rectangle R = {(t,.x) :|t| <1, |x| < 1}. 
We claim f does not satisfy the Lipschitz condition on R. Consider the pair of points 
(t, x,) and (ft, 0) in R where x; > 0. Then 


If (t,x1) — f(t, 0) ~t/s 
ual 


x, —0 = 


— oo as xj > 07, 


and hence there exists no .% such that (2.1.5) holds. 
Remark 2.1. Consider (2.1.1) on the rectangle D C R x R defined by 


D={(t,x):|t —to| <a, |x — xo] < 5}, 

where a and D are positive constants. Let 
T=t—to, uU=x—Xo, and g(t,u)= f(t+to,u+X9). 

Then the function g is defined on the rectangle 

D* ={(t,u):-a<t <a, —b<u <b}, 
and the IVP (2.1.1) is equivalent to the IVP problem 

u’ = g(t,u), u(0)=0. 
For emphasis, we restate the following definition. 


Definition 2.1.3. We say that x is a solution of (2.1.1) on an interval J ifx: J —> R 
is differentiable, (t,x(t)) € D fort € J, x(t) = f(t, x(t)) fort € 7, and x(to) = xo 
for (to, xo) € D. 


In preparation for the next theorem, we observe that the IVP (2.1.1) is equivalent 
to 


t 
x(t) = 10+ f f(s, x(s))ds. (2.1.6) 
to 
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Relation (2.1.6) is an integral equation since it contains an integral of the unknown 
function x. This integral is not a formula for the solution, but rather it provides an- 
other relation satisfied by a solution of (2.1.1). We have the following definition. 


Definition 2.1.4. We say x : J > R is a solution of the integral equation (2.1.6) on 
an interval I if fo € 7, x is continuous on J, (t, x(t)) € D for t € TJ, and (2.1.6) is 
satisfied for ¢t € J. 


The next theorem is fundamental for the proof of the existence theorems. 


Theorem 2.1.1. Let D be an open subset of R?, and let (t9,xo) € D. Then x is 
a solution of (2.1.1) on an interval I if and only if x satisfies the integral equation 
given by (2.1.6) on I. 


Proof. Let x(t) be a solution of (2.1.1) on an interval J. Then fo € J, x is differen- 
tiable on J, and hence x is continuous on J. Moreover, (f, x(t)) € D fort € I, x(to) = 
xo, and x’(t) = f(t, x(t)) for t € I. Now an integration of x’(t) = f(t, x(t)) from fo 
to t gives (2.1.6) for t € J. For the converse, if x satisfies (2.1.6) fort € J, then to € J, 
and x is continuous on J. Moreover, (tf, x(t)) € D for t € J, and (2.1.6) is satisfied 
for t € J. Thus x(t) is differentiable on 7. By differentiating (2.1.6) with respect to f, 
we atrive at x’(t) = f(t, x(t)) for all t € J and x(t) = x9 + vy f(s, x(s))ds = xo. 
This completes the proof. 


A graduate textbook in differential equations would be incomplete without the 
statement and proof of Picard’s local existence and uniqueness using successive ap- 
proximations. In the next section we prove similar theorems on Banach spaces using 
fixed point theory. 

We note that Picard’s local existence and uniqueness theorem and Cauchy—Peano 
existence theorem are widely used, and variant proofs of the theorems can be found 
in [17], [29], [31], [54], and [70]. 

The heart of proving our next results is the construction of a sequence of functions 
that converge to a limit function that satisfies the IVP (2.1.1), although the members 
of the sequence individually do not. 

Theorem 2.1.2 addresses the three basic issues: 

(1) Members of the constructed sequence {x,} exist for all time. 

(2) The sequence converges, and the limiting function satisfies the integral equation 
(2.1.6) and hence the IVP (2.1.1). 

(3) The limiting function, which is a solution of (2.1.1), is unique. 


Theorem 2.1.2. (Picard’s local existence and uniqueness) Let D C R x R be defined 
as 


D=({(t,x):|t — tol <a, |x — x0] <5}, 


where a and b are positive constants. Assume that f € C(D,R) and f satisfies the 
Lipschitz condition (2.1.2). Let 


M= max |f(t,x)| (2.1.7) 
(t,x)ED 
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and 
h=min{a e 2.1.8 
"M 


Then the IVP (2.1.1) has a unique solution, denoted by x(t, to, X09), on the interval 
|t — to| < h and passing through (to, xo). Furthermore, 


|x(t) — x0| <b for |t —to| <h. 


Proof. Before we begin the proof, we recommend to look at Fig. 2.1. 


x 


D-big rectangle 


R-middle rect | 


xo +b 
to 


x0 —b 


to —a to tot+a 


FIGURE 2.1 


Interval of existence. 


First, we note that since f is continuous on D, condition (2.1.7) is automatically 
implied. The idea of the proof is to construct a sequence of functions {x,,} that con- 
verges uniformly to a unique x on the interval |t — fg9| < A and is a solution of (2.1.1). 
We begin by successively defining a sequence of functions {x,} for |t — fo| < h by 
setting 


xo(t) = x0, 


t 
nOaige / Fs. x08))ds, 
i) 


t 
Xn(t) =m +f f (8, Xn-1(s))ds. (2.1.9) 
0) 


According to (2.1.7) and (2.1.8), we have that 


|x1(t) —xo| <hM <b for |t —to| <A. 
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t 
Therefore : Ff (s, x1(s))ds can be defined for |t — fo| < , and hence 
0) 
|x2(t) — x9] <AM <b. 
Similarly, we may show that x3(t),..., X(t) are well defined on |t — fo| < h. Thus 
t 
[xn (t) — xo| = if F (Ss, Xn-1(8))ds| < M|t — tol. (2.1.10) 
Li) 


Next, we show that {x,} converges uniformly to a function, say x, on |t — fo| <h. 
Note that 


Xn (t) = xo(t) + [x1 (t) — xo(2)] + [x2 ) — 21] +--+ + Pen ©) — xn-1)], 


or 
n—1 
Xn(t) = xo(t) + [xj — 2/1. 
j=0 
Taking the limit if it exists, we have 
n—-1 
lim xp (t) = xo(t) + lim Ye) —xj;(t)]. (2.1.11) 
noo noo 5 : ; 
i= 


Our next task is to compute |x j+1(¢) — x; (t)|. Using (2.1.9) and then (2.1.2) followed 
by (2.1.10) give 


t 
|x2(t) — x1 (t)| <| | f(s, x1(s)) — f(s, xo(s))|ds 
i) 
is 
< x | |x1(s) _ xo(s)|ds 
10 
t t 
< xm [ Iv tlds = Km f (s — to)ds 
to i) 
t — to)” 
— kM iat |t —to| <a. 
2 
In a similar fashion, we obtain 


t 
|x3(t) — x2(t)| =| | f(s, x2(s)) — f(s, x1(9)) [ds 
10 


t 
< x / |x2(s) = x1(s)|ds 
10 
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t =a? 
=k f kao as 


=MK , |t—to| <a. 


3 (t — to)? 
3! 


Continuing this way, we arrive at 


= to)/ 


Ixj@t) — xj 1) <M E 71 (2.1.12) 


To complete the induction argument, we assume that (2.1.12) holds for j and show 
that it holds for j + 1. Using (2.1.12), we arrive at 


t 
|xj+1(t) — x; (t)| <| | f(s, x79) — FS, xj-1(9)) [ds 
10 
t 
Kf |xj(s) — xj—-1(s)|ds 


_ J; 
<x f mki& a eas 


t—t are (t—to)it! 
aye = _ ior It —tol <a. 
pG+D) (j+1)! 


Next, we substitute (2.1.12) into (2.1.11) and get 


n—1 


. M |K (t — to) J+} 
Ne Ga 
J= 


(j+ 1)! 


n—1 


M .. (Kh)it! 
<xo+ Kh do Gail G+)! 


M Kh 
<xo + = _ 1) < OO. 
x0 (c 


Hence, by the Weierstrass M-test, {x, (t)} converges uniformly, say to a function x(t). 
Next, we show that x(f) is a solution of (2.1.1) on D. We have 


|x(t) — xol = x(t) — xn (1) + Xn(t) — xl 
1X) — xn] + len) — xl 
<x) — xn()| + M|t — 10 


for every fixed t € (ft? —h,to +h). As a result, 


|x(t) — x9] = lim |x(t) — xn(t)| + M|t — to| 
xXx— 00 
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=0+ M|t —10| 
<Mh<b 


for t € (0 —h, to +h). So x(t) € D. If the sequence {x, (t)} converges uniformly and 
{xn (t)} is continuous on the interval |t — to| < h, then 


t t 
lim y F (s, Xn(s))ds =I lim f(s, x,(s))ds 
n— oo to to noo 
by the uniform continuity of f. As a consequence, 
x(t) = lim x741(0) 
nC 


t 
ee ie i f(s, %n(s))ds 
n—->oo to 


t 
Sk / slim f(s, Xn(s))ds 


10 
t 
= x0 +/ f(s, lim x,(s))ds 
to n—-> oo 
t 
=xo+ / f(s, x(s))ds, 
1 
that is, 
t 
x=x0+ f f(s, x(s))ds, |t—to| <h. (2.1.13) 
1 
The integrand f(s, x(s)) in (2.1.13) is a continuous function, and hence x(t) is dif- 
ferentiable with respect to ¢, and its derivative is equal to f(t, x(t)). So the proof of 


the existence is complete. It remains to show that the solution x(t) on D is unique. 
Let y(t) be another solution of (2.1.1) with y(t) = xo. Then 


t 
yi) =xo+ | f(s, y(s))ds. 
1 
Let 


N= sup lx(t)—y@)l. 


|t—to|<h 


Then by the Lipschitz condition, we have 


t 
Ix(t) — y(O| < x/ |x(s) — y(s)|ds (2.1.14) 
a) 


or 


Ix(t) — y)| < KN|t — tol. 
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The substitution of this estimate into (2.1.14) yields 
x(t) — y(t)| < KN|t — tol" /(2!) for |t — tol <h. 
Repeating this substitution, we obtain 


|t — to|”” 
Ix) — y®| = KN———, m=1,2...., 
mM: 


for |t — to| < h. Since the right side of this inequality tends to zero as m — oo, we 
have that 


N= sup |x(t)— y(t)|=0. 


|t—to|<h 


This completes the proof. 


We will give another proof of the uniqueness once Gronwall’s inequality is intro- 
duced. To illustrate the above procedure, we provide the following examples. 


Example 2.2. We consider the IVP 
x/(t) =2t(1+ x), x(0) =0. 


Set xo(t) = 0. Then for any n > 1, we have the recurrent formula 


t 
mnt) = f 28(1 + xXn-1(s))ds. 
0 
For n = 1, we have 


t 
n= f 2sas=P, 
0 


and for n = 2, 
t 4 
2 ee 
x2(t) =i 2s(1+s*)ds=t°+ —. 
0 2, 
We leave it to the reader to verify that 


6 
ee 
! n! 


ed 
Xn(t) =? + a 
2 3 


Definition 2.1.5. A sequence {x,} of functions in C((a, b], R) converges uniformly 
tox € C([a, b], R) if lim ||x, —x|| =0. 
n—-> oo 

It was established in Example 2.2 that 

ra . 

(1)! 

m=) I> 71 
i=0 
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and the true solution of the IVP is given by x(t) =e’ * _ 1 on the interval [0, 1]. Thus 


[o,@) 
tim ln = x1 = lim [ max eo 1-(e 1)|] = lim = = 


n—>0o [ max, Sone 
1=n 
Therefore 
n (1? i 
ty 2 


jim xn() = lim ae l=e -1. 


Example 2.3. Next, we use Theorem 2.1.2 to find the interval of existence of the 
unique solution of 


x(t) =14+x7, x(0) = 1. 
Let 
D={Ga)2 =a, |x = 135), 


where a and b are constants. It is clear that 


M= max |f(t,x)|=1+(+))7 
(t,x)ED 


and 


: b . b 
h= min{a, vi => min{a, Ted adb! 


b 
So we must find the maximum of the function g(b) = —______,.. Using calculus, 
1+(1+b) 
we see that the function g has its maximum at b = V2 and is given by g(J/2) = 
__¥2___ Thus the interval of existence and uniqueness is 
1+(1+/2)? 


ltl < 


, or . , 
1+(14+/2)2 14+(4+ 72)?’ 14+ (14 V2)? 

Now suppose in Example 2.3 we chose D = {(t, x): |t| < 10, |x — 1| < D}, that 
is, a = 10. Then the interval of existence found above is much smaller or included in 
(—10, 10). Recall that the interval of existence is included in D. 


The next corollary is an immediate consequence of Theorem 2.1.2 and the discus- 
sion leading to (2.1.5). 


Corollary 2.1. Suppose DC RxR, f € C(D,R), and ar is continuous on D. Then 
for any (to, Xo) € D, the IVP (2.1.1) has a unique solution on an interval containing to 
in its domain. 


As an example, consider 


x(t)= tx? 
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Then 
of t 


— tx! /2 cae 
f(t, x) =tx and Ox Ont 
are continuous in the upper half-plane defined by x > 0. We conclude from Corol- 
lary 2.1 that for any point (fo, x9), xo > 0, there is some interval around fg on which 
the given differential equation has a unique solution. 

Unlike Theorem 2.1.2, the next Cauchy—Peano theorem only guarantees the exis- 
tence of a solution and not uniqueness. This is due to the fact that f is not required 
to be Lipschitz. 

Based on Remark 2.1, we may restate Theorem 2.1.2. 


Theorem 2.1.3. If f and or are continuous on the rectangle 
D* ={(t,x):-a<t<a, —b<x <D}, 


where a and b are positive constants, then there is a number h in the interval (0, a] 
such that the IVP 


x' = f(t,x), (0) =0, 
has a unique solution, denoted by x(t, 0,0), on the interval —h < t <h. Furthermore, 
Ix(t)| <b for |t| <h. 
Example 2.4. As an application, we consider the IVP 
x’ =t(x+1)*, x0) =0, 


on the rectangle 
D* ={(t,x):—-l<t<1, —2<x <2}. 
12 


2-2 


It readily follows that the IVP has the solution x(t) = We want this solution 


t 2 
to be in D*. This means that |t| < 1 and < 2. This is true if and only if -—~ < 
2=1 V3 


2 2 
t < —~, from which it follows that h = —~. If we choose a larger b, then we can 
V3 V3 
arrive at a larger h. However, h must be chosen so that h < ./2. This is due to the fact 
that 


Theorem 2.1.4. (Cauchy—Peano existence theorem) Let f :R x R > R be continu- 
ous in a neighborhood of a point (to, x9) € R?. Then there exists > 0 such that the 
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IVP (2.1.1) has a solution ¢ on the interval I := [to — a, tg + a], that is, there exists 
a function (not necessarily unique) 6 = $(t) defined on I such that 


dt) = ft, ¢M), tel, 


and (to) = Xo. 


Proof. Since f is continuous in a neighborhood of the point (to, x9) € IR’, there exists 
a positive constant a such that the rectangle 


D={(t,x):|t— tol <a, |x — xo] Sa} 


: ' a 
is centered at (to, x9). Moreover, M = max |f(t, x)| exists. Next, we set a := ‘Th 
(t,x)eD 


By Theorem 2.1.1, we know that ¢ = @(t) satisfies the [VP (2.1.1) if and only if 


t 
o=0+ | f(s, o(s))ds. (2.1.15) 
1 


Since f is uniformly continuous on the compact set D, given ¢ > 0, there exists 
56 = 6(e) such that 


|t —t| <6 and |x —x| <5 imply |f(t,x) —f@,X)| <e 


S 1 
for all (t, x), (t, x) € D. Therefore let ¢ = e, = — andé =46,,n =1,2,.... Choose 
n 


: . : ) 
with 4)” = to and ten) = to + @ for 0 < j < k(n) with ban =<. 


We define the approximation ¢, on [xo, x9 + @] by $n (to) = xo and ¢’, (t) = f (to, xo), 


points ¢ 


to <t< ae Then it is clear that a = dy a), Continuing in this manner, we get 
that 


CO-7G a tee Seer: (2.1.16) 


Note that ¢, is piecewise continuous and may have a jump discontinuity in its deriva- 
tive at the partition points, and hence we define 


PO- fdr), tf <1< 1), 


0 t=x” 
’ a J * 


An(t) = 


As a consequence, we may define 


t t 
Pn (t) = x0 + i by, (s)ds = x9 + iy [ f(s, bn(s)) + An(s)]ds. 
to to 


Next, we try to have an upper bound on A,,(t). Note that from (2.1.16) and the defi- 


- <t<t” 


nition of A; (t) we have that for t pete 
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n= |£00,2) — fbn 


<2 — da()| < [x — x 


(n) 
a 


< Mey? — 171 
on 


1 
ah ae 
where we have used that 
e009] < [x — x0 | < dy. 


By the Ascoli—Arzela theorem, there exists a uniformly convergent subsequence 
of ¢, that converges to 


PG) = jim a, (6) for t € [fo — a, to +a], 
that is, 
bn = 0+ | ‘LF, dny(5)) + AnGo)lds 
0 
which converges to 


t 
omeree / LF(s, 6(s))ds. 
1 


This completes the proof. 


Example 2.5. Consider the [VP 
x'(t) = 2tx7/?, x(0) =0 


Of(t,x)  4t 

~ 3x 1/3 
continuous at the points where x = 0. Here xg = 0, and no matter how small we 
chose b > 0, the interval [—b, b] will always contain 0. Therefore we cannot apply 
Theorem 2.1.2. Instead, we will use Theorem 2.1.4. Let a = 1. Then on the rectangle 


is not 


Then f(t, x) = 2tx?/> is continuous everywhere, whereas 


D=({(t,x):|t| <1, |x| < 1}, 
we have 
1 
M= max |f(t,x)|}=2 and a= -=0.5. 
(t,x)E€D 2 


Therefore by Peano’s existence theorem, we have at least one solution x : [—0.5, 
0.5] > [-1, 1]. As a matter of fact, the IVP has the two solutions x(t) = 0 and 


x(t) = Ae both going through the initial point (0, 0). 
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Next, we state and prove Gronwall’s inequality, which plays an important role 
throughout this book in proving the boundedness, stability, and uniqueness. 


Theorem 2.1.5. (Gronwall’s inequality) Let C be a nonnegative constant, and let 
u, v be nonnegative continuous functions on [a, b] such that 


t 
v(t) <C +f v(s)u(s)ds, a<t <b. (2.1.17) 


Then 
v(t) < Cela", a <t<b. (2.1.18) 
In particular, if C = 0, then v = 0. 


t 
Proof. Let C > 0, and let h(t) =C + / v(s)u(s)ds. Then 
a 


h'(t) = v(t)u(t) < A(t)u(t). 
So we have the differential inequality 
h'(t) — h(t)u(t) < 0. 


Multiplying both sides of the above expression by the integrating factor eta meee 


we get 
(n@e-/e adr) < 0. 


Integrating both sides from a to t¢ gives 
h(tye fa" )4s _ pla) <0, or A(t) < lauds, 
Finally, 
vit) <h(t) < Celawr4s, 
If C = 0, then from (2.1.17) it follows that 
t 1 t 
v(t) <| v(s)u(s)ds < — +/ v(s)u(s)ds, a<t<b 

a m a 

for any m > 1. Then from what we have just proved we arrive at 
v(t) < relat Os a <r <p. 
m 


Thus for any fixed t € [a,b], we can let m — o to conclude that v(t) < 0, and it 
follows that v(t) = 0 for all t € [a, b]. This completes the proof. 
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Now we are in a position to revisit the proof of the uniqueness of the solution in 
Theorem 2.1.2 by using Gronwall’s inequality. 

Just for a reminder, we assume that the hypotheses of Theorem 2.1.2 hold. Sup- 
pose (2.1.1) has two solutions x(t) and y(t) and set w(t) = x(t) — y(t). Then 
w(t) = x'(t) — y'(t). Therefore 


t t 
" w'(s)ds = w() — wr) = f (70s, x(9) — £6, y)) as with 
t 


0 1 


w(to) = x(to) — y(to) = 0. 


So we atrive at 
t 
|w(t)| | I f(s, x(s)) — f(s, y(s))lds 
10) 
t 
=k | |x(s)—yoylas 
i) 
t 
= cal |w(s)|ds. 
to 
Applying Gronwall’s inequality with v(t) = |w(t)|, C = 0, and u(s) = 1, we get 
|w(t)| = 0 for all ¢ such that |t — to| < h. We conclude that w(t) = 0 and hence 


x(t) = y(t). 
The next theorem shows the significance of Theorem 2.1.5. 


Theorem 2.1.6. Suppose $(t) is continuous on [0, oo) and differentiable on (0, 00). 


If 
lim ¢(t) =0 
too 
and 
Cc 
i |p'|dt < 00, 
0 
then all solutions of 
x" + (1+ (t))x =0 (2.1.19) 


are bounded. 


Proof. Multiply both sides of (2.1.19) by x’ and integrate the resulting equation from 
0 to f to arrive at 


GO? | Go 
2 7 2 


t 
+f $(s)x(s)x'(s)ds = cy, 
0 
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where c is aconstant. Integrating by parts the third term from the left and rearranging 
give 


t 
x*(t)(1+ @()) = 202 — (x(t)? + / o' (s)x?(s)ds 
0 


£ 
Zoe / $/(s)x2(s)ds, 
0 


where c2 is a constant. Since lim; (t) = 0, we may choose fg large enough so 
that 1+ @(t) > 5 for all t > to. This translates into 


2 1 2 ry 2 
x OG) <x*(1\(L4+ (1) <2co+ | 6'(s)x*(s)ds 
0 
or 
t 
x(t) <4e +2 | |b’ (s)|x?(s)ds, t > to. 
0 
Thus by Theorem 2.1.5 we have that 
x(t) < 4cre2Jo lo'(s)ids 
< 4cye2 Jo Ip"(s)lds _ Wf < o0 for some positive constant M 


and for all t > 0. Since x(f) is continuous on 0 < t < fg and fg is arbitrary, it follows 
that x(t) is bounded. 


2.2 Existence on Banach spaces 


In this brief section we discuss the existence of solutions of the [VP (2.1.1) on Banach 
spaces using the contraction mapping principle. For reminder, we restate the IVP 


x’ = f(t,x), x(t) = x0, (2.2.1) 


where we assume that f : D > R is continuous and D is an open subset of R x R. 
The next theorem is another version of Picard’s theorem where f/f satisfies global 
Lipschitz condition. 


Theorem 2.2.1. (Picard theorem; global version) Let f € C(R x R,R), and let f 
satisfy the global Lipschitz condition (2.1.2), that is, there exists a constant K > 0 
such that 


If (t,x) — f(t, y)| < K|x — y| forall (t,x), (t,y) €D. 


1 
Let h = — and tg € (—h,h). Then there exists a unique x : (—h,h) > R satisfying 
the IVP (2.2.1). 
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Proof. Define the space 


=C((—h, h], R). 


Then B endowed with the norm 


|x|| = max |x(t)| 
te[—h,Al 


is a Banach space. By Theorem 2.1.1, we have that 


t 
x(t) =xo+ f(s, x(s))ds, t >to. (2.2.2) 
10) 


The problem comes down to finding a fixed point of the operator Y : B > B defined 
by 


t 
P(x) (t) = x0 + i Ff. x(9)ds. 
Li) 


By a fixed point we mean that there is an element x € B such that A(x) = x, which 
is equivalent to finding a solution of (2.2.2) and therefore of (2.2.1). Note that F 
assigns to any function x € B another function, which we denote by “x. Thus for 
x to be defined, we need to evaluate its value at some t € [—h, A]. It is clear that 
# is continuous in x. To show that Y(x)(t) is a contraction, we let x, y € B. Then 
for t € [—h, h], we have that 


t 
IAMO- AHO <| I f(s, x(s)) — f(s, y(s))|ds 
i) 


t 
<x | xs) — y(@)|es 
to 
<hK|x— yl 
<+| 
< 2 x— yll. 
Thus 


| A(x) - PO) < ae Aa - AY)O| 


te[—h, 


bt 
<K / Om Ore 
10 


=~ |x — : 
y 


Thus # defines a contraction mapping on the Banach space B, and hence it has 
a unique x € B that is a solution of (2.2.1) by Theorem 2.1.1. This completes the 
proof. 
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Theorem 2.2.2. (Picard Theorem; local version) Let JY C R x R be an open set con- 
taining (0, xo), and let f € C(Y,R) be such that | f | < M for a positive constant M. 
Suppose f satisfies the local Lipschitz condition in x on Y with Lipschitz constant 
K > 0. Choose 


1 
he (0, ra so that [—h, h| x {|x —x0|<hM} CY 


(note that such a choice of h is possible since the set D is open). Then there exists 
a unique x : (—h, h) > R satisfying the IVP (2.2.1). 


Proof. Let I =[—h,h], where h is as chosen in the hypothesis. Let B= {x € R: 
ly — xo| < 4M}. Define YA: CU, B) > CU, B) by 


t 
Ao =xo+ | f(s, x(s))ds. 
1 


The problem reduces to showing that W(x) = x. First, we show that 7 is well- 
defined. It is clear from the choice of h that if x e CU, B), then f(t, x) is well- 
defined for all t € [—h, h], and hence xp + Sis F (s, x(s))ds is well-defined. Moreover, 


since | f| < M, we have that x9 + to f(s, x(s))ds is continuous. Thus A(x)(t) is 
a continuous map. Finally, 


t 
|P(x)@) — x9] S i I f(s, x(s))|ds <hM. 
i) 


Thus Y(x)(t) € B for all t € [—h,h], and hence A(x) € CU, B) assigns to any 
function x € B another function, which we denote by “x. Thus for Wx to be defined, 
we need to evaluate its value at some t € [—h, h]. It is clear that W is continuous 
in x. To show that A(x)(t) is a contraction, we let x, y € C(/, B). Then for each 
t € [—h, h], we have that 


|AaX)-AYI< sup |AwWO- AO)O| 
te[—h,h] 


b 
<K i) LCs) — p(s) 
a) 


< Ktmax|x(s) — y(s)| 


|s|St 


1 
Scale y= 5 le = vl: 


Thus # defines a contraction mapping on the Banach space C(/, B), and hence it 
has a unique x : (—h,h) —> R that is a solution of (2.2.1) by Theorem 2.1.1. This 
completes the proof. 


Consider the differential equation x’(t) = 1 + x?. Theorem 2.2.1 cannot be ap- 
plied here since f(t, x) = 1+.x? does not satisfy the global Lipschitz condition on R, 
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whereas Theorem 2.2.2 is applicable. Moreover, Theorem 2.2.2 only requires find- 
ing Ze R x R containing (0, xo). In addition, in both Theorems 2.2.1 and 2.2.2 the 
initial time fo can be chosen so that fo 4 0. 


2.3 Existence theorem for linear equations 


In this section we eloquently apply Theorem 1.4.4 to show that the linear non- 
homogeneous differential equation 


x/(t) =a(t)x(t) + f(t), G35 


where a, f € C(R, R), has a unique solution ¢ € C(R, R) with ¢ (to) = xo. We have 
the following theorem. 


Theorem 2.3.1. Let (to, x9) € R?, and let a, f € C(R, R). Then (2.3.1) has a unique 
solution @ : (—00, co) > R with (to) = xo. 


Proof. Let s, M > 0. Find M such that for a given s, we have |a(t)| < M for t € 
[to — s,to +s]. Let B= C([to —s,tot+s], R). Then the space B endowed with the 
supremum norm || - || is a Banach space. Theorem 2.1.1 implies that 


t t 
xy =x0+ [ awa du f f(u)du. 
to iW) 


For x € B, define Y : B > B by 


t t 
P(x)\(t) =xo + i a(u)x(u)du +f ftu)ds. 
to to 


Clearly, A(x)(t) is a continuous map. Let x, y € B. Then 


|A(x)- AQ) < sup |FAO-200! 


te[to—s, to+s 
= uf |x(u) — y(u)|du 
10 
< Ms||x — yl 
or 
|P@)—- PY) Ss Msllx — yl. 


Now if Ms =a < 1, then Y is a contraction, and by Theorem 1.4.3, there is a unique 
fixed point ¢ € B, that is, A(d) = @, which is a solution of (2.3.1) on [to — 5, f9 +5]. 
However, we claimed that the solution exists and is unique on (—oo, 00). To show 
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this, we use Theorem | .4.4 by letting s be an arbitrary and find an integer m > 0 such 
that Y” is a contraction: 


IPW)-FYWWOl=|APa)O -— APONOI 


t 
< sup Lf iawn Pera — Aovaoidu| 
Lt) 


tE[fo—s, to+s] 
t 
2. 
<M xsi f le tld 
to 


<M? |x — yl |t — to|?/21. 
Continuing this process, we claim that 
|P' (x) @) — P'(y)@)| <M" |t — tol" |x — yl|/m! 


for positive integer m. The claim is already proved for m = 1, 2. We assume that it 
holds for a positive integer k and then show that the result holds for k + 1. Indeed, 


PO a(t) — PHC) @| =| P(A) — AY ONO 


t 
< sup | / |a(u) ||P (x)(u) — P*(y)(u)|du| 
ti 


te[to—s, tots] 0 


t 
< Mey vill f |u — tolkdu/k}| 
to 


< MP Ix — yl [te — toh /&+ DI. 
Thus 
| P™ (x)(t) — P™(y) (1) < M™s™ |x — y||/m!, 


and for large m, we have 


(ms) 


m! 


and the proof is complete by Theorem 1.4.4. 


2.4 Continuation of solutions 


As we mentioned before, the interval of existence and uniqueness guaranteed by 
Theorem 2.1.1 is, in most cases, shorter than the actual interval of existence 
and uniqueness. This is misleading, since usually it is not the maximal interval of 
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existence. To see this, we consider 
x/(t) =tx, x(0) = 1. 
Let 
D={(t,x):|t| <a, |x —1| <5}, 


where a and b are constants. It is clear that 


b 
h —_— i se = i is 
min{a } = min{a 


ad +b)" 


Thus for any positive constants a and b, we will always have h < 1, since eitherh <a 


orh< Sa < 1/a. On the other hand, the true solution of the IVP is x(t) = of [2 
which exists for all te R. 
Consider the IVP 
x’ = f(t, x), (2.4.1) 
x(0) = xo. (2.4.2) 


In the following theorems, we only consider ¢ > 0 (t < 0 is left as an exercise; see 
Exercise 2.17). 


Theorem 2.4.1. Suppose D=Rx R, f € C(D,R), and ar is continuous in D. If a 
solution & of (2.4.1)-(2.4.2) exists on [0, a] for some positive a, then it can be con- 
tinued to a solution on some longer interval (0, a +r] for some positive constant r. 


Proof. Without loss of generality, we take x9 = 0. Let 
R=[a—a,a+a] x [§(a) — a4, (a) +a], 


where a is small enough so that a — a > 0. Since f is continuous on the rectangle R 
containing the point (a, §(@)), we have, by applying Theorem 2.1.2 to the [VP 


x’ = f(t,x) (2.4.3) 


x(a) = &(a@), (2.4.4) 


that a solution ¢ of (2.4.3)-(2.4.4) exists on some interval [aw, a +7]. We claim that 
the function € given by 


§(t) if0<t<a, 


d(t) ifa<t<a-+r, 


E(t) = 


solves (2.4.3)-(2.4.4) on [0,a +r]. To do so, we must show that the left and right 
derivatives exist at a and are equal. Since ¢(@) = &(q@), the right derivative is given 
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by 
‘ E(ats)—-E(a) .. o(at+s)—€&(@) 
wm _ oo _ = lim SS 
sO S s—>0t S 
— tim P@t9 = oH 
= mM 
s—O0r Ss 


= $'(a) = f(a, o(@)) 
= f(a, &(a)) = &"(a). 


Similarly, the left derivative is €’(a@) due to the fact that & is a solution on [0, a]. This 
completes the proof. 


Theorem 2.4.2. The maximal interval of existence is open. 


Proof. Let J be the maximal interval of existence. If ~ of Theorem 2.4.1 is in J, then 
the same theorem shows that the interval (a — r, a+r) is also in J. Hence J is open. 
This completes the proof. 


We have the following theorem. 


Theorem 2.4.3. Suppose D=R x R, f € C(D,R), and ay is continuous in D. If 
x is a solution of (2.4.1)—(2.4.2) on some interval J containing to = 0, then x is the 
unique solution on J. 


Proof. Suppose J = (a, w). Without loss of generality, let x9 = 0. Then Theo- 
rem 2.2.1 implies that for some positive constant h, x is the unique solution on the 
closed interval [—h, h]. We will prove the uniqueness on the half-open interval [0, w). 
Suppose there are two distinct solutions z; and z2 of (2.4.1)-(2.4.2) on [0, w). Then 
we have z; = Z2 on [0, A], and there exists t* € (h, w) such that z; (t*) 4 z2(t*). Let 


£ =inf{t € (0, w): a(t) £aa(t*). 


It follows that h < & < t*. We claim that & < t*. Since z,(t*) # z2(t*) and since 
z1 and z2 are continuous, z; # Z2 on some interval to the left of t*. This proves the 
claim. Due to the continuity of z; and zz and the equality z; = zz on [0, t*], we must 
have z;(t*) = z2(t*). In addition, we know from Theorem 2.4.1 that the IVP 


x =f (t,x), #1) = 216) 


has a unique solution on some interval, say [& — 8, & + 6], for some positive con- 
stant 6. It follows that z; = z2 on [&, +], which contradicts the definition of €. This 
shows that the solution x is unique on [0, w). Similarly, we may prove the uniqueness 
on (a, 0]. This completes the proof. 


Theorem 2.4.4. Assume the hypotheses of Theorems 2.4.1 and 2.4.3. If the maximal 
interval of existence J =[0, w), where w < 00, then the solution $(t) of x' = f (t, x), 
x(0) = 0, is unbounded in [0, w). 
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Proof. We prove by contradiction by assuming that the solution is bounded on [0, w). 
Since f(t, @) is bounded on [0, w), there is a positive constant M such that f(t, @)| < 
M. Then by Theorem 2.1.1, we have that 


t 
$(t) = / f(s, b(s))ds. 
to 


Let {t;} + w. Then for any j and k > j, we have that 
tk 
ow) —ol=| f f(s, $(s))ds} < M|tj — tl. 
tj 


Now the sequence {t;} is convergent and hence is a Cauchy sequence. Therefore 
{@(¢;} must be a Cauchy sequence and so also convergent. Since the sequence {t;} 
was arbitrary and converging to w, we have that lim @(t) exists. Thus we may 


—>w 
extend ¢ to w by letting ¢(w) be the limit. Now consider the IVP 
x= f(t,x), 
x(w) = o(w). 
This IVP has a unique solution on [w —r, w+r] for some positive constant r, which is 


an extension of the solution ¢ a little further. Thus [0, w] is not the maximal positive 
interval of existence, which is a contradiction. This completes the proof. 


Consider the [VP 
x(t) =x, x(0) =1. 


The function f(t, x) = x? €C!(R), and according to Theorem 2.1.2, the IVP has 
a unique solution on an open interval containing 0. Solving the IVP, we obtain the 
1 


solution x(t) = =. The maximal interval of existence must include t = 0. Thus the 


solution is defined on its maximal interval of existence (—oo, 1). Furthermore, 


lim x(t) = —oo. 
t>1—- 


According to Theorem 2.4.4, the IVP of Example 2.4 has the maximal interval of 
existence (=s/7, /2). It is the case since 

‘a i 

lim =oo and lim 


(vay PF nC 


2.5 Dependence on initial conditions 


One of the main characteristics a mathematical model should enjoy is that a solution 
should depend continuously on initial conditions. In other words, a small change in 
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5 |— (to,xo) = (0,0) Y 
= (to, x0) = (0,0.01) 
— (to,x0) = (0.1,0.1) 


t >| 
4 4 
FIGURE 2.2 
The three graphs stay close with three different initial conditions (0, 0), (0, 0.1), and 
(0.1, 0.1). 


the initial conditions should result in a small deviation in the solutions. We have seen 
that a solution x(t) of the IVP 


x’ = f(t, x), x(to) = x0 (2.5.1) 


depends not only on the time f¢, but also on the initial point (fo, xo). Thus, to empha- 
size such dependence, we use the notation x(t, fo, xo) to denote x(t). Consider 


x'(t) = (x — 1) cos(t), x(to) = xo, 


which has the solution 
sin(t) 
x(t) = —— (x9 —- 1) +1. 


esin(to) 


In Fig. 2.2 we plot the graphs of the solution for three different initial conditions, 
which shows the sensitivity of the solution to the initial data. 


Example 2.6. The scalar (IVP) 
x'(t)=x?, x(0) =xo, t>0 


has the solution 
XO 


x(t) = 


1 — xot 


with maximal interval [0, +). As the initial value x9 increases, the maximal interval 
of existence shrinks as depicted in Fig. 2.3. 
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FIGURE 2.3 


Dependence on xo. 


Example 2.7. In Fig. 2.4 we display the graph of 
x’ =xsin(x) +t 
and show its sensitivity to the initial data. 


We have the following theorem. 


a 
Theorem 2.5.1. Let DC Rx R, and suppose f and of are continuous and bounded 


in D. Let x and y be two solutions of (2.5.1) passing through the initial conditions 
(to, X9) and (ty ; x5 ), respectively. Assume that the two solutions exist on a common 
interval (a, B), where a and B are finite. Then to each € > 0, there corresponds 6 > 0 
such that 


\to — t9| < 6, |xo —x9| <6 imply |x(t) — y(t)| <e, t,t* € (a, B). 


Proof. Since f and ar are continuous and bounded on D, there are positive constants 
M and K such that 


0 
If ol <M, Ee =k. 


By Theorem 2.1.1, we have that for rf, t* € (a, B), 


t t 
ee J F.x@))ds, yO" #28) = 38+ / Fe y@)ae. 
to 6 
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6 
—3.23208 
3.23209 
2 | -3.23210 


x(0)=-3.23208 
x(0)=-3.23209 
x(0)=-3.23210 


FIGURE 2.4 


Sensitivity of solutions of x’ = x sin(x) + ¢ to the initial data. 


By noticing that 


t t te 
; fis.x)as= [ fisvxds-+ f° f(s, x(s))ds, 
to to to 


e t t* 
[ f(s, y(s))ds = fis.yoyas-+ f f(s, y(s))ds, 
t 


we arrive at 


t 
x(t, to, x0) — y(t", 19, x9) S iso — 51+ | f I f(s, x(s)) — f(s, y(s))|ds 


t* 
+| fife. ronids 
t 


tx 
+| J ire.xonids 
10 


t 
<lxo—a§1-+K| f 1x00) —yoylas 
i 

+ M|tj —to| + M|t* -t| 


t 
<5+K| [ Ix(s)) — y(s)lds] + 2M6. 
ig 
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Letting v(t) = |x(t) — y@ |, C=6 +2M6, and u(s) = K, we obtain from Theo- 
rem 2.1.5 that 


|x(t, to, x0) — y(t*, 1, xg) < 8 + 2M)eK 45! < 81 + 2M) eK OP) 


or 


|x(t, to, x0) — y(t*, th, xo) | <e 


eek (a-B) 
14+2M 


for 6 < 


. This completes the proof. 


Theorem 2.5.1 shows that the solution x(t, fo, xo) of (2.5.1) passing through the 
initial data (to, x9) is a continuous function in (f, fo, x9). We end the chapter with the 
following theorem. 


Theorem 2.5.2. Let f, g be defined in a region D C Rx R and satisfy the hypotheses 
of Theorem 2.5.1. Set 


M= sup |f(t,u)— g(t, u)|. 
(t,uj)eD 
Let x and y be the solutions of the IVPs 
x= f(t,x), x(to)=x0 and y'=glt,y), yo) = yo. 
respectively. Then the solutions x and y satisfy the estimate 


M 
Ix(t) — y(1)| < xo — yoleX tol + a Cael = 1), (2.5.2) 


where K is given in the proof of Theorem 2.5.1. 


Proof. Using a similar setup as in the proof of Theorem 2.5.1, we get 


t 

Ie(t) — y@)1 < bxo — ol +f 
to 

t 

< |xo — yol +f 
to 

t 
+f 
to 


E 
< |xo — yol +f [ Kix(s) — y(s)| + M|as. 


1 


f(s, x(s)) — gs, v(s))]as 


f(s, x(s)) — fs, y(s))]as 


f(s, x(s)) — gs, v(s))]as 


Let U(t) = |x(4) — y(¢)| and use an improvisation of Exercise 2.9 to obtain the esti- 
mate given by (2.5.2). This completes the proof. 
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Suppose M in Theorem 2.5.2 is small, that is, M < ¢ > 0. If |t — t9| < a for 
positive constant a, then inequality (2.5.2) yields 


éE 
Ix(t) — y(OI < lxo — yole®* + pa -1), 


and thus if |xo — yo| < 6 for some 6 > 0, then the two solutions remain close to each 
other. In other words, Theorem 2.5.2 says that if two differential equations have their 
right-hand sides “close together,’ then their solutions cannot differ very much. 


2.6 Exercises 
Exercise 2.1. Show that f(t, x) = 
the Lipschitz constant K. 


ad is uniformly Lipschitz on R and identify 
x241 


Exercise 2.2. Compute the Lipschitz constant K for each of the functions in the 
regions indicated. 


1. f(t,x) =P +24, {(t, x): |t] <2, |x] <3}. 

2. f(t, x)= t? cos(x) +t sin(x), {(t, x): |t| <2, |x| < oo}. 

3. f(t, x) =tlx|, {(f, x): |t]) <1, |x| < co}. 

4. ft,xn= t? sin(x) cos(x), {(t,.x) : |t| < a, |x| < oo} for a positive constant a. 
Hint: when you perform | f(t, x) — f(t, y)|, add and subtract the term sin(x) cos(y). 


Exercise 2.3. Apply the Picard iterations to the [VPs 


1. x/(t) =tx, x(0) = 1, 
2. x'(t) =2t(1 +x), x0) =2, 


and show that the obtained {x,(t)} of each iterate converges to the true solution of 
each IVP (the true solution is the solution found by solving the IVP). 


Exercise 2.4. Use Theorem 2.1.2 to find the interval of existence of the unique solu- 
tion of the following differential equations: 


. x(t) =x?, x(0) =2. 
. x(t) =54+-x?, x(1) =2. 
. x(t) = x3, x(0) =2. 
. x(t) =t+x7, x(0) =0. 
. x(t) =14+x?, x(0) =0. 


akRWN — 


Exercise 2.5. Explain why the IVP x’(t) = tx — sin(x), x(0) = 2, has a unique solu- 
tion in the neighborhood of the point (0, 2). 
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Exercise 2.6. Let f be scalar and continuous in both arguments. Show that if x is 
a solution of the second-order differential equations x” (t) = f(t, x(t)), x(to) = xo, 
x' (to) = x1, then it satisfies 


t 
x(t) = x9 + x1 (t — to) +f (t—s) f(s, x(s))ds. (2.6.1) 
10 


Hint: Integrate twice and use the general formula 


[ [ [ ee. ora ]as =| [ f as]eece. dyn. 


Exercise 2.7. Explain why neither Theorem 2.1.2 nor Theorem 2.1.4 can be applied 
to the IVP 


x2 


x(t)= a x(0) =1. 
Use separation of variables and find the family of solutions 


-1 


OTe ee 


for some constant c. Is it possible to find c? 


Exercise 2.8. Check for the existence and uniqueness of solutions of the following 
IVPs and sketch the corresponding rectangle D: 


» (t— 1x! (t) =x? +1, x(0) = 1. 
» (tf — 1x! (t) =x? +1, x(1) =0. 
2 x(t) =t! Px 4x7, x(0) =3. 
. (#2? — 1)x/(t) =tx, x(0) = 1. 
. tx2x/(t) = 29 — 7, x= 1. 


ahWN = 


Exercise 2.9. (Generalized Gronwall’s inequality) Show that if f, u, v are nonnega- 
tive continuous functions on [a, b] such that 


t 
u(t) < f(t) +f v(s)u(s)ds, a<t<b, 
then 
t t 
u(t) < fo+ | u(s) f (s)els "4 ds, a<t <b. 


Exercise 2.10. Find all nonnegative continuous functions f : [0, 1] > R such that 


t 
fins | f(s)ds, O<t<1. 
0 
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Exercise 2.11. Let K,, K2 be positive constants, and let f be a nonnegative contin- 
uous function on [a, b] such that 


t 
fi) = Ki + Ka f f(s)ds, a<t <b. 


Show that f satisfies 
(Ose 


Exercise 2.12. (Another form of Gronwall’s inequality) Let K,, K2 be positive con- 
stants, and let Cp be a nonnegative constant. Suppose f is a nonnegative continuous 
function on [0, ] such that 


t 


Os cot f [Ki f(s) + Ka]ds, O<t <h. 
0 
Show that f satisfies 


K 
Kit 2 Kit _ ) 
FO) = Cock + (e it) 


Exercise 2.13. Let x be a solution of (2.1.1) and suppose f satisfies the global 
Lipschitz condition with constant K for all ¢ € R. Suppose that for all ¢ € R, 
i | f(s, 0)|ds < M for positive constant M. Then x(t) satisfies the inequality 


Ix(t)| < (|xol + Me), 


Exercise 2.14. Consider the system 


y’ =—cy +x” ycos"(y). 


Use Gronwall’s inequality to show that 
(a) y(t) is bounded for all t > 0 whenever c = 0 anda > 1, 
(b) y(t) > 0 as t > oo whenever c > OandiA = 1. 


Exercise 2.15. Consider the scalar differential equation 


1 
_ — hb)x, t>0, 2.6.2 
x Or Tag x, t= (2.6.2) 


where a is constant. Show that if y(t) = e~“'x and x is a solution of (2.6.2), then 
ly(t)| < |x(O)|e*!™"+ for some constant c > 0. 
In addition, show that if a < 0, then 


|x(t)| ~ 0 as t> oo. 
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Exercise 2.16. Let g : [0, 00) — [0, co) be given by g(x) = xe. Use the contrac- 
tion mapping principle to prove that the graphs of g and the line y = x intersect at 
a unique point (a, a). 


Exercise 2.17. Prove Theorem 2.4.1 for t < 0. 


Exercise 2.18. Consider the IVP 
x! (t) = 2tx, x(to) = x0. 


(a) Use Theorem 2.1.2 to find the largest interval of existence and uniqueness of 
solutions. 

(b) Solve the IVP. 

(c) Find the maximal interval of existence when to = 0 and xo > O and find the 
limits at the end points. 


Exercise 2.19. Consider the IVP 
x(t)=2t+D04+ x’), x(0)=0. 


(a) Solve the IVP. 
(b) Find the maximal interval of existence. 


Exercise 2.20. Finish the proof of Theorem 2.5.2 to obtain (2.5.2). 
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CHAPTER 


systems of ordinary 
differential equations 


We briefly discuss how the existence and uniqueness theorems of Chapter 2 are 
extended to systems. Then we develop the notion of the fundamental matrix as a so- 
lution and utilize it to write solutions of non-homogeneous systems. The author made 
a conscious decision not to dwell too much on the topic of Jordan canonical forms 
since it is a well-developed subject in linear algebra. 


3.1 Existence and uniqueness 


For motivational purpose, we consider the second-order differential equation 
x" (t) ta*x(t) =0, (3.1.1) 


where a is some nonzero constant. Eq. (3.1.1) is commonly used as a model de- 
scribing a mechanical process that periodically oscillates. For example, it is used 
to describe oscillations of a pendulum, provided that the angle change is small or 
of a spring with a small deflection. We use the transformation x(t) = x(t), which 
is the displacement of the oscillating object. (For the pendulum, it is the angle 
made with the vertical.) Introducing the second transformation, the velocity or an- 
gular velocity x(t) = x'(t), and differentiating, we get x}(t) = x'(t) = x2(t) and 
x(t) =x") = —a*x(t) = —a?x1(t). We therefore arrive at two first-order differen- 
tial equations 


Thus we consider the general system of ordinary differential equations 


/ 
x= AiG, X1,.--,%Xp), 
/ 
x= f2(t, X1,.--,Xn); 
/ 
Xn = In(t, x1, @ ace Xn). 
Advanced Differential Equations. https://doi.org/10.1016/B978-0-32-399280-0.00009-7 5 7 
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Using the vector notations 


x] 
x2 
.. — 

Xn 
and 

fi@,x) 

fot, x) 

fC X= ; : 

Tn (t, x) 

the above system can be written in the vector form 
x’ = f(t,x). (3.1.2) 

Different norms on R” were discussed in Chapter 1. For x = (x1, x2,...,Xn), we 


consider the norm 


n 


Ix = | D04?. 


i=l 


However, in this section, it is more convenient to use the norm that we denote by |x| 
given by 


n 
Ix] = So lail- 
i=l 


It is assumed that |x;| denotes the absolute value. The two norms are topologically 
equivalent in the sense that the open sets in R” are the same under either norm. A set 
S in R” is said to be open if for each x* € S, there is a d(€) > 0 such that xe S 
whenever |x — x*| < 5(¢). It can be easily shown that ||x|| < |x| < ./n||x|| for all 
x € R”. This shows the two norms are equivalent. As a direct result of this, if 6! is a 
sequence of vector-valued functions such that for some function ¢, ||! — ¢|| > 0, 
i — oo, then |g! — ¢| — 0, i > oo, and the converse holds too. 
Next, we extend some definitions and theorems from Chapter | to systems. 


Definition 3.1.1. The function f : DCR x R” — R" is said to satisfy the global 
Lipschitz condition in x if there exists a positive constant K (called the Lipschitz 
constant) such that 


If (t,x) — f(t, y)| < K|x—y| for (t,x), (¢,y) € D. (3.1.3) 


If for every subset Q C D, there is a positive constant K such that (3.1.3) holds, 
then the function f satisfies a local Lipschitz condition in x. Now we discuss how to 
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determine the Lipschitz constant K. Let R C D be such that 


R= {(t,x):|t—to| <a, |x — xo| < 5} 
and assume that f and all its partial derivatives ah are continuous in R. Then the 
J 
Lipschitz constant K can be defined as 


K= — 3.1.4 
YD hl reall Cr 


Throughout this section, we assume f : D > R” is continuous, where D C R x R” 
is Open. 


Definition 3.1.2. Let (to, x9) € D. We say that x € R” is a solution of the IVP 
x’ = f (t,x), x(0) = x0, (3.1.5) 


where xo = (X01,X02,---,X0n)/, on an interval J if t9 € J, x: 1 > R" is differen- 
tiable, (t, x(t)) € D fort € 7, x’ = f(t, x) fort € 7, and x(to) = xo. 


In preparation for the next theorem we observe that the [VP (3.1.5) given in Def- 
inition 3.1.2 is equivalent to the integral relation 


t 
xi) =xo+ | f(s, x(s))ds. (3.1.6) 
10 


We have the following definition. 


Definition 3.1.3. We say x: J] > R” is a solution of the integral equation given by 
(3.1.6) on an interval J if t9 € 7, x is continuous on 7, (t, x(t)) € D for t € J, and 
(3.1.6) is satisfied for t € J. 


The proof of the next theorem is identical to that of Theorem 2.1.1. 


Theorem 3.1.1. Let D be an open subset of R"*!, and let (to,xo) € D. Then x is 
a solution of (3.1.5) on an interval I if and only if x satisfies the integral equation 
given by (3.1.6) on I. 


Theorem 3.1.2. (Picard’s local existence and uniqueness) Let D C R x R" be de- 
fined by 


D={(t,x):|t— tol <a, |x—Xo0| <5}, 


where a and b are positive constants. Assume that f € C(D,R") satisfies the 
Lipschitz condition (3.1.3) with Lipschitz constant K given by (3.1.4). Let 


M= max |f(t,x)| (3.1.7) 
(t,x)ED 


Copyright Elsevier 2022 


Me 
60 CHAPTER 3 Systems of ordinary differential equations 


and 
h = min{ ; } (3.1.8) 
= min{a, —}. Al. 
M 
Then the IVP 
x’ = f (t,x), (0) = x0, (3.1.9) 
where Xo = (x01,X02,---,X0n)!, has a unique solution, denoted by x(t, to, X9), on the 


interval |t — to| < h and passing through (to, xq) with |x — xo| < b. 


Proof. We only give a sketch of the proof since it is identical to that of Theorem 2.1.2. 
Using Theorem 2.1.1 we have 


t 
x(t) =x + | f(s, x(s))ds. 
10) 


In other words, if x(t) is a solution to the above integral, then it is to be understood 
that 


t 
xi) = 01+ f fils, x1(S),..., Xn (s))ds, 
i) 


t 
x2(t) = x02 +f S2a(s, x1 (8), ..., Xn (s))ds, 
10 


t 
Sn(t) = 30m + i FGA Oonaoee: 
Li) 


As for Picard’s iterations, we define 
t 
X+1,1(t) = x01 + / Sis, Xk,10S), +. Xk nls))ds, 
10 


t 
aed auws : Fe eC eee Oe 
10 


t 
Xk+1n(t) = X0n + TIn(S, Xk, 105), ..+,Xkn(s))ds, 
10 


or 
msi=not fo foo.) k=0,1,...,n, (3.1.10) 
uy) 
where 
Xo = (x01,X02,---+X0n)", 


Copyright Elsevier 2022 


—CCCCC“(HUUCOCtsé(‘(’!USN#W”(NW”N”WN”N”_ONCsi‘(‘“‘ialaa=oooo 


3.1 Existence and uniqueness 61 


and 


xe (t) = (Xe,1 0), ¥e,20), «+ Ken (0). 


Now use (3.1.10) and Theorem 2.1.2 to finish the proof. 


To illustrate Picard’s iteration, we present the following example. 


Example 3.1. Consider the linear 2 x 2 system 


x4 (t) = 2x, — 3x2, 


x(t) =x, — 2x2, 


with the initial conditions given by the vector 


Spf BON Vo 
co-n-(%)-(4)} 
Setting k = 0, the first iteration is 
t 
x10) =1 +f (2—3)ds =1-t, 
0 
t 
x12(t) =—1 +f (1 —2)ds =—-1-t. 

0 

Next, setting k = | gives 
t 
x2 1(t) = 1 +f [2(1 — s) — 3(-1 —s)]ds = 14 5t + 17/2, 
0 
t 
x2, 2(t) =—1 +f [( —s) —2(-1—s)]ds =-14 3t+17/2. 
0 

Using the method of the next section, we can show that the true solution is 

3e' —2e 

x= : 
e' —2e 


Remark 3.1. It is essential to know that Theorems 2.1.4, 2.2.1, 2.2.2, 2.4.1, 2.4.2, 
2.4.3, and 2.5.1 can be easily extended to the IVP (3.1.9). The instructor may assign 
them as exercises. 


Next, we consider the nth-order differential equation 
x(t) = g(t, ae a i) 
and use the transformation 


xi(t)=x"-Y@), i=1,2,...,n 
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to arrive at the following system: 


/ 
x) =X2, 
tg 
Xy = X3, 
/ 
Xn a4 ester seasawys 


The right side of this system defines a vector function f(t, x). To fully describe the 
solution, we impose the initial conditions 


x"—D (4g) =xoi for i=1,2,...,n, 


where xo; fori = 0, 1,...,— 1 are given constants. Thus our existence and unique- 
ness results mean that we can impose initial conditions on the function x and its first 
n — | derivatives. 


Example 3.2. Consider the system 


xj =1, 
x= = 
| i o. 
x] 
ta 
3 x? 
with initial vector 
1 
x1() i 
1 “i 
x2x(-) | =] 0 
1 -1 
x3(=) 
Then the function 
1 
x3 
f@Gx= |] x 
x2 


is continuous with continuous partial derivatives on the set D = {(x1, x2, x3) € R?: 
x1 > 0}, and hence D is the region of existence of solutions. 


To find the maximal interval, we try to solve the system. From x; = 1 we get 
x1(t) =t, where we have applied the given initial condition. Substituting x; =f into 
the second and third components of the system, and solving for t*, we arrive at 

x3 x2 


pa o 
Xo *3 
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from which we have 
Gag =o or x2 4+-x7=C. 
di’? 3 , 2.1 3 
Applying the initial conditions, we get C = 1, that is, 
ie + ie =I, 


It is clear that x2(r) = sin(+) and x3(t) = cos(+) satisfy x3 + x3 = 1 and the initial 
conditions. Thus the solution is given by 


t 
Paral 
x(t) = | sin(;) |, 
cos(+) 
and hence the maximal interval of existence is (0, 00). Note that lim, x(t) does not 
t>0 


exist. 


Theorem 3.1.3. (Global existence) Let B be a positive constant, and let D = R". Let 
to > 0, and let J = [to, B] be an interval in R. Suppose f : J x D > R" is continuous 
and satisfies the global Lipschitz condition on J x D with Lipschitz constant k > 0. 
Assume the existence of two positive continuous functions M(t) and N(t) such that 


| f(t, x)| < M(t) + N(t)|x| on J x D. (3.1.11) 
Then the nonlinear initial value problem 
x’ = f(t, x), x(to) = Xo (3.1.12) 
has a unique solution on the entire interval J. 


Proof. First, we show a solution x: J > R” exists on [fo, 6]. Due to the continuity 
of the functions M(t) and N(f), there are two positive constants M; and N such that 
M(s) < M, and N(s) < N, on [to, 6]. Thus, for to < t < 6, we have that 


t 
Ix()| = xo + f f(s, x(s))ds| 
i) 
t 
< |xo| +f (M, + Ni|x(s)|)ds 
ut) 
t 
< |xol + Mi (hi -n)+ f Nj |x(s)|ds. 
to 


Applying Theorem 2.1.5, we arrive at the inequality 


Ix(t)| < [|xo| + M,(B1 — 1) ]eN1F1—0) 
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This shows |x(t)| is bounded on [f9, 8]. Now we show uniqueness. Suppose (3.1.12) 
has two solutions x(t) and y(t) and set w(t) = x(t) — y(t). Then w(t) = x’(t) —y’(r). 
Therefore 


t t 
/ w (s)ds = w(t) — w(t) = (f0,x()) = f(s.y(s)) as with 
t 0) 


0 


w(to) = x(to) — y(to) = 0. 


So we arrive at 
t 
Iwie)| < i Lf (s,x(s)) — f(s, y(s))|ds 
10 
t 
2% ‘ Ix(s) —y(a)|ds 
to 


t 
= Kf |w(s)|ds. 
to 


It follows from Gronwall’s inequality that |w(t)| = 0 for all ¢ € [tg, 6] and the solu- 
tion is unique on [fo, 6]. This completes the proof. 


3.2 x’ =A(t)x 


Consider the linear system of ordinary differential equations of the form 


xy =a (t)x1(t) + ay2(t)x2(t) +... din(t)xn(t) + g(t), 
X5 = ag1 (t)x4 (t) + az2(t)x2(t) +... , don (t)Xn(t) + galt), 


x = ani (t)x1(t) + an2(t)x2(t) +... Ann (1) Xn (t) + gn(t), 
where the functions aj;, g;, 1 <i <n, 1 < j <n, are continuous real-valued func- 


tions on an interval 7. Using vector and matrix notations, the above system is equiv- 
alent to the vector equation 


x'(t) = A(t)x(t) + g(t), (3.2.1) 
where 
x] x 
x SS — ‘ x’ = *y ‘ 
Xe a 
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and 
Q1 a2 ++) Ain gi(t) 
a2, a22,+** Aan g2(t) 
AQt):=] | : |. g®s= : 
Ani Q@n2 °°: Ann 8n (t) 


for t € J. Note that the matrix functions A and g are continuous on an interval J if 
and only if all their entries are continuous on J. 


Definition 3.2.1. We say the n x 1 vector y is a solution of (3.2.1) on J if y is 
continuously differentiable on J and 


y'(t)=AMy(@) + g(t) 
forallte J. 


We denote the space of n-tuple continuously differentiable functions x : J > R” 
by C!(/, R"). Next, we define matrix norm. 


Definition 3.2.2. A norm of a square matrix A is a non-negative real number denoted 
by ||A||. There are several different ways of defining a matrix norm, but they all share 
the following properties: 


|A|| => 0 for any square matrix. 

|A|| = 0 if and only if A = 0 (zero matrix). 

|kA|| = |k|||A|| for any constant k. 

|A + B|| < ||A|] + || B|| for square matrices A and B. 
|AB|| < |All] Bll. 


oe oN 


Example 3.3. Let A be a matrix with entries aj;,1<i<n,1< j <n, thatis, A= 
(a;;). We define the following possible norms on the matrix A. 


1. The 1-norm: 
n 
All: = max, (dX lai!) 
i= 


(the maximum absolute column sum). 
2. The infinity norm: 


n 

Allo = max (}7 lai!) 
l<i<n \4 i 
j= 


(the maximum of the sums of the absolute values along each row). 
3. The Euclidean norm: 


WAlle= | 2 > 0 @ij)? 


i=l j=1 


(the square root of the sum of squares of all entries). 
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Note that if J is the identity matrix, then ||7||; = ||Z||o = 1. 


Next, we state and prove our first existence and uniqueness result regarding 
(3.2.1). 


Theorem 3.2.1. Suppose A(t) and g(t) are continuous on some interval a <t < b. 
Then (3.2.1) has a unique solution $(t) on the interval a < t < b with 6(to) = n and 


a<to <b. 

Proof. Let || - || be a suitable matrix norm. For the existence, it suffices to show that 
solutions remain bounded for all a < t < b. We know from Theorem 3.1.1 that ¢ 
given by 


t 
ot)=n + [A(s)P(s) + g(s)]ds 
0) 
is a solution of (3.2.1) with # (tp) = n. Let 


Ki =(|n|, Ko = max |g(t)|(b—a), and K3= max ||A(¢)|]. 
tela.b] tela.b] 


Then 


t 
Ol sin +| / [A(s)b(s) + g(o)]ds 
1 
t t 
<K+| lAcvioGylas-+ f Ig(s)|ds 
to 1) 
t t 
< K,+ max aol f |p(s)|ds + max ie f ds 
te[a,b] to te[a,b] to 
iL 
<Ki+ Ks | [66Vlds + max lg(1(b~ a) 
to te[a,b] 
t 
= (x: Ee K>) . K | 1b(s)\ds. (3.2.2) 
10 
Applying Theorem 2.1.5 (Gronwall’s inequality) we arrive at the inequality 


IPO) < (Ki + Kae 


< (Ki + iene, (3.2.3) 


From (3.2.3) we see that solutions are bounded for all t € [a, b] and hence exist. This 
completes the proof of the existence. For the uniqueness, we assume the existence of 
two solutions ¢; and ¢2 of (3.2.1) passing through (fo, 7). Then imitating the proof 
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of the existence, we arrive at 
t 
Jo) dl =| f Asytou6s) — datonids| 
10 
t 
< / ILA(S)IIIb1(5) — da(s)las 
1 
t 
< max ||A()I| / I1(s) — d2(s)|ds 
te[a,b] fo 
t 
<K; i: ICs) — o@)lde. 
10 


By Theorem 2.1.5 (Gronwall’s inequality) it follows that 


Ibi (t) — 62(¢)| =0 for all ¢ € [a, 5], 


and hence ¢) (t) = ¢2(t) for all t € [a, b]. The proof is complete. 


As a consequence of Theorem 3.2.1, we have the following corollary. 


Corollary 3.1. If A(t) and g(t) are continuous on R, then the unique solution $(t) 
of (3.2.1) is defined for allt € R. 


In the next discussion, we try to estimate the error between two solutions. Let ¢ 
and $2 be two solutions of (3.2.1) with ¢;(fo) = m1 and ¢2(to) = n2, respectively. 
Then 


t 
|b1(t) — b2(¢)| S 161 o) — $2(40)| + [/ A(s)[b1(s) — 62(s)]ds 
1 
ib 
<|m — nl +f I|A(s)|I]b1(s) — b2(s)Ids. 
to 
Using Gronwall’s inequality, we arrive at 


If. (4) — da(t)| < In — malelo AOA, (3.2.4) 


which is an estimate of the error between the two solutions at two different initial 
conditions. 


Example 3.4. Consider the differential system 


= —Xx7 sin(t) + 4, 


f 
x, = 
xh = —x1 + 2txp — x3 +e", 


1 
x = 3x1 cos(t) +x2+ ra 5t°. 
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Consider two solutions ¢,(t) and ¢2(t) on the interval (1, 3) with initial vectors 


7 
oi2)=] 3 
—2 
and 
6.7 
$2(2) =} 3.2 
—1.9 
Next, we compute the norm of the matrix 
0 —sin(t) 0O 
A(t)= -1 2t -1 


3 cos(t) 1 1/t 


Using the 1-norm, we get 


1 
||A(o)|| = max{1 + 3] cos(e)], | sin(#)| +2¢ +1, 1+ =) 
or 
1 
[|A(@)|| < max(4,2+2r,1+—}=2+42r <8, 1<t <3. 


Using the estimate formula given by (3.2.4), we get 


11 (t) — do(t)| < 0.3 + 0.2 + 0.1)e/2 HA@llds 
< 0.6e/2 me 


< 0.6e8"—?) < 0.6e8C-” = 1790. 


Example 3.5. (Pendulum with friction) Fig. 3.1 shows a simple pendulum with mass- 
less string of length LZ and a bob of mass m acting under the external influence of 
gravity. Let g be the acceleration of gravity, m be the mass of the bob, L be the 
length of the rod, and b be the coefficient of friction (damping), which all are positive 
constants. The period is the time it takes for the bob to swing from its farthest right 
position to its left farthest position and back. Let s(t) be the distance along the arc 
from the lowest point of the bob at time f, with displacement to the right considered 
positive. Let 6(t) be the corresponding angle with respect to the vertical. The gravita- 
tional force is directed downward and has the magnitude mg. The force acting in the 
tangential direction is —mg sin(@). Then the motion is modeled by the second-order 
differential equation 


ds . 
a =-—gsin(@). 
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FIGURE 3.1 


Pendulum with friction. 


Now s = L@ as L is the radius of the circle, and so 
d’6 
dt? 


We add damping to the model and assume that the damping force is proportional to 
the velocity. As @ is our independent variable, the damping is represented as the force 


& . 
=-— = 0). 
7) 


proportional to the angular velocity, say, —b——. The negative sign indicates that the 


damping force is in the opposite direction of the motion. Then the model takes the 
form 


mL6” +mgsin(@) + bL6’ =0. (3.2.5) 
Assume the initial data 
(to) =O, 9" (to) =o. (3.2.6) 


To apply Theorem 2.4.4, we put (3.2.5) into a system. Thus we let x;(t) = 0(t) and 
x2(t) = 0’ (t) and obtain the nonlinear two-dimensional system 


ty = 2; 
P58 anya es, Ga%) 
L m 
with corresponding initial conditions 


X1(to) = 60, x2(to) = wo. (3.2.8) 
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Let 


ftx)= ( is 
—4 sin(x1) — 2x2 


Clearly, f satisfies the global Lipschitz condition on R*. Thus by Theorems 2.4.3 and 
2.4.4, the solution exists on some interval [fp, a), a > 0. We will show that a = co 
by appealing to Theorem 2.4.4. Define the energy function E : [to, «) x R* > [0, 00) 
by 


1 
E (0) = E(t, x12) = 5330) + ae = cos(x1(t))). (3.2.9) 


Then along the solutions of (3.2.7) we have that 


oR 3 xh + © sin(x1) x, 
dt L 


= »(-2 sin(x1) — x) een 
L m L 
= 23 <0. 
Let fo < t <a and integrate the above inequality from fg to f to get 
E(t) — E(to) <0 
or 


1 . 
E(t) < 50 + + (1 _ cos(60)). 


We have from (3.2.9) that 5x3 (t) < E(®), so that 


|x2(t)| < sofia? + F(1 - cos(60)) | = M. 
Using this in the first equation of (3.2.7), after integrating, we find 
lx1(t)| < |@0| + M(t — to) for to <t <a. 
Now suppose for contradiction that a < oo. Then on [fo, a), 


1x1(t)| < |@0| + M(@ — to) and |x2(t)| < M. 


lx] = [a2 +23 < /M + [60] + M@— 4), 


which is bounded on [tg9,a@). This is a contradiction to Theorem 2.4.4, and hence 
a = oo. So the maximal interval of existence is [t9, 00). It is worth noting that the 
energy function will be referred to as a Lyapunov function, which we will study in 
more detail in Chapter 7. 


Thus 
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In Example 3.5 the energy function had to be chosen just right in order to yield 
the right results. Generally speaking, for any second-order differential equation of the 
form 


x" + f(x)x’ + g(x) =0 (3.2.10) 


and under more conditions on g, the energy function may take the form 


E(t) := E(t, x1,x2) = 530 + [ g(s)ds (3.2.11) 
0 


by transforming (3.2.10) into a system using the transformations 

xi(t)=x"-Y@), i=1,2. 
On the other hand, if we do not transform (3.2.10) into a system, then we may use 
the energy function 


x(t) 
E(t):= E(t,x)= se + f g(s)ds, (3.2.12) 


where 5 (x' )* corresponds to the kinetic energy, and Io ® g(s)ds represents the po- 
tential energy. 


3.2.1 Fundamental matrix 


Solving the non-homogeneous equation 
x'(t) = A(t)x(t) + g(t) (3.2.13) 
requires solving the homogeneous system 
x'(t) = A(t)x(0), (3.2.14) 


where A(t) is ann Xx n matrix of coefficients a;;(t), which are assumed to be con- 
tinuous on an interval J. Recall that a solution x(t) of (3.2.14) is an n-tuple of C : 
functions x; : J > R. We adopt the notation 


x1(t) 
x2(t) 
x(t) = 
Xn(t) 
The solution x maybe considered as a C! vector-valued function x : J] > R”. The 


space of such functions is denoted by C!(/,R”). If -Y is the solution space of 
(3.2.14), then Y C C'(/, R”). 
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Definition 3.2.3. We say that a set { f|, fo,..., fn} of m x 1 vector functions defined 
on an interval IJ is linearly dependent on I if there exist constants c1, C2, ..., Cn, not 
all zero, such that 


cifitcofat...t¢enfn=9 


for every t € I. If the set of functions is not linearly dependent on the interval /, it is 
said to be linearly independent. 


We have the following important theorem regarding the solution space .7. 
Theorem 3.2.2. The solution space .¥ is a linear vector space. 


Proof, Let x € C!(/, R”) be a solution of (3.2.14). It is clear that x = 0 is a solution 
of (3.2.14). If x(t,) = 0 for some t, € J, then x(t) = 0 for all t € J. This is true due 
to the uniqueness of the solution. Thus the zero solution is in .7. Next, we show 
that .Y is closed under addition and scalar multiplication. Let ¢) (t) and ¢2(t) be two 
arbitrary functions in .Y, and let c, cz be constants in R. Set y(t) = c1@1 (t) + c2@2(t). 
Then 
y(t) = (c1pi(t) + c2g2(0))’ 

= ciP\(t) + c294(t) 

= ci A(t)h1 (1) + c2A(t)g2(t) 

= A()(cii(t) + erda(0)) 

= A(t)y(t). 
Next, we show that the set of solutions of (3.2.14) is linearly independent. Let 


{oi (t), o2(t), eee on (t)} 


be a set of solutions of (3.2.14). We show that if {1 (t), d2(t), ..., bn (t)} is linearly 
independent at some t¢, € J, then the set is linearly independent for all t € /, that is, 


cidi(t) + cob2(t) +... + Cngn(t) =0 


only in the case cj = c2 =... = Cy, = 0. Suppose the contrary, that is, there are c;, 
i=1,2,...,n, not all zero such that 


c1i (th) + c2g2(t1) +... + Cndn(ti) =0 


for some ft; € I, t; #+,. Now we use the same constants c; to define a function for all 
tel, 


x(t) =c1oi(t) + coga(t) +... + CnGn(t). (3.2.15) 


Then by the above relation we must have x (t;) = 0, since it is a solution of (3.2.14). 
Thus by uniqueness x(t) = 0 for all ¢ € J. This is a contradiction to the fact that 


C19] (tx) + C22 (te) +... + Cndn (te) = 90 
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only in the case c) = cz =... = Cy = 0. This completes the proof of the linear in- 
dependence. Left to show that .Y is an n-dimensional subspace of the vector space 
C!(1, R"). Let e1, eo, ..., én be the standard basis of R”. Then by Corollary 3.1 there 
exists a set {f1(t), d2(t),..-,¢@n(} of n solutions that form a set of solutions of 
(3.2.14) satisfying 


1 (to) = e1, 62(to) = 2, ..., dn (to) = en. (3.2.16) 


This set of solutions is linearly independent for all t ¢ 7 and hence forms a linearly 
independent set in the solution space .”. Let #(f) be an arbitrary solution of (3.2.14) 


and define 
po = $ (to). (3.2.17) 
Now since ¢g € R”, there are constants cj,i = 1,2,...,, not all zero, such that 
do =cei +c2€2 +... + nen. (3.2.18) 


Using the same constants of (3.2.18), we may define a new function wy: J > R”, 


WO) =cibi(t) + coat) +... + Cn dnt). (3.2.19) 


Since each ¢;,i = 1, 2,...,”, is a solution of (3.2.14), so is w(t). By (3.2.16) and 
(3.2.18), we have that y(to) = ¢@o. This and (3.2.17) imply that w and @ have the 
same initial condition, and hence by the uniqueness of the solution we have that 


w(t)=(t) forall teR. 
From (3.2.19) it follows that the arbitrary solution may be written as 


w(t) =cio1(t) + c2b2(t) +--+ + cndnl(t), 


which is a linear combination of the solutions ¢;, i = 1, 2, ...,. Therefore the set of 
solutions 


{é1(), o2(t), sig eg on(t)} 


is a basis for the solution space .7. This implies that the dimension of .Y is n. This 
completes the proof. 


Definition 3.2.4. (Fundamental set of solutions) A set of n solutions of the linear 
differential system (3.2.14), all defined on the same open interval /, is called a fun- 
damental set of solutions on / if the solutions are linearly independent functions on J. 


We have the following corollary. 


Corollary 3.2. Let A(t) be ann x n matrix of continuous coefficients aj; (t) on an in- 
terval I. If {1 (t), d2(t), ..-, dn(t)} form a fundamental set of solutions on I, then 
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the general solution of (3.2.14) is given by 
X(t) = chi (t) + cr2(t) +--+ + cn dn(t) 

with constants c;,i =1,2,...,n. 

The following definition is needed for the next theorem. 
Definition 3.2.5. Let f and g be two continuous functions on R. Then we write 

f(x) = O(g(@)) 
if there exists a positive real constant M and a real number x* such 
| f(x)| < Mg(x) forall x >x*. 


Theorem 3.2.3. If {¢,(t), b2(t),...,¢@n(t)} form a fundamental set of solutions 
of (3.2.14) on I and X is the matrix function with columns {¢1(t), $2(t), ---, Pn()}, 
then 


Sig t(A())ds 


detX (r) = det X (to)e for tél. (3.2.20) 


Proof. Let the Wronskian w(t) := det X (t). Let tg € J and expand X (t) around fg: 
X(t) = X (to) + = to) X" (to) + O((t — t0)”) 


= X (to) + (t — 19) A(to) X (to) + O((t — t0)°) 
= [I + (t — %)A(to)]X (to) + O((t — t0)”). 


As a consequence, we have 
detX (t) = det( [1 ee: 10) A(to)] )detX (10) 
or 


W(t) = det[ J + (t — 19) A(to) |W (to). 


By the Terence Tao matrix identity, which says 
det(C + hB) =det(C) +h tr(adj(C) B) + O(h’), 
we have that 
det(I + (t — 19) A(to)) W (to) = W(to)[1 + (t — to)tr(A(to))] 


or 


W(t) = W(to)[1 + (¢ — t0)tr(A(o)) J. (3.2.21) 
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Next, we expand W(f) in Taylor series around fo: 
W(t) = W(to) + (t — to) W' (to) + O((t — t0)”). 
Substituting the value of W(t) given by (3.2.21) into the above equality gives 
W'(to) = W (to)tr(A(to)). 
Since fp is arbitrary, for any time tf € R, we have the equation 
W'(t) = Wt)tr(A(d)), 
which has the solution 


W(t) = W(tp)e/0 44 for te I. 


This completes the proof. 


Definition 3.2.6. (Fundamental matrix) A matrix solution © is called a fundamental 
matrix solution (or, shortly, fundamental matrix) of (3.2.14) on an interval J if its 
columns form a fundamental set of solutions. If, in addition, ®(t9) = J, then a funda- 
mental matrix solution is called the principal fundamental matrix solution (or, shortly, 
principal matrix). 


Theorem 3.2.4. The matrix ® is a fundamental matrix of x' = Ax at to if and only if 


(a) ® is a solution of x! = Ax 
and 


(b) det@(to) £0. 

Proof. We know that ®’ = A®. Let 
© =[41(t), d2(0), -.-, dn), 

where the columns of ® consist of $1 (t), $2(t), ..., bn(t). Then 
& = [41 (1), H0),--.. 6,00), 


and 


A® =[Agi(t), Aga(t),..., Adn(0)]. 


Since two matrices are equal if and only if their corresponding columns are the same, 


®'(t) = A®(t) 
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if and only if 
xi = Ax; 


or if and only if each column of ® is a solution. 
Condition (b) is equivalent to the linear independence of 


$1 (to), 2(to), ---, On (to). 


This completes the proof. 


We claim that the matrix 


aie et te 
“hee! ager 


is the fundamental matrix for the system 


0 1 x] 
“= F 
vo=(2, 2) (3) 
To see this, we have 


, —e! e'—te’ —e! (l—tye 
®'(t) = = 
et —-et—(l1—-te™ e! —2e'+te* 
On the other hand, 
( 0 1 Je _ ( 0 1 ) e! te! _ -e’ (1-fne 
-1 -2)° ~\-1 -2/)\—e- (l—te* Net tet Det] 


This proves the claim. For the next two theorems, we suppress the argument f. 


Theorem 3.2.5. [f ® is a fundamental matrix of (3.2.14), then ®C, where C is an 
arbitrary n Xx n nonsingular constant matrix, is a fundamental matrix of (3.2.14). 
Conversely, if YW is another fundamental matrix to (3.2.14), then there exists a con- 
stant nonsingular n x n matrix C such that V = ®C for allt € I. 


Proof. Let ® be a fundamental matrix of (3.2.14) on 7. Then 
(®C)' = O/C = (A(t) ®)C = A(t)(@C). 
So @C solves (3.2.14). Next, 
det(®C) = det® detC £0, 


and by Theorem 3.2.4, ®C is a fundamental matrix of (3.2.14). Conversely, let ® and 
W be two fundamental matrix solutions of (3.2.14). Since ®&—! = J, we have that 
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&'b-! + (7!) =0 or (©!) = —6—!0’O—!. Now we differentiate O~! W and 
obtain 
(ol wy’ — (o~!)/'w i ow’ 
=-0 'o’o 'w+o°!w’ 
=(-@ 1A oO! 4+ 071A) Y 
=(-67'AG) + 01 A(t) b 
0. 


Therefore integrating the above expression gives ®-!'W = C for some n x n 
constant matrix C, or Y = ®C. Furthermore, as YW and ® are fundamental matrix 
solutions, we have det® 4 0 and detW ¥ 0, and hence detC ¥ 0. This completes the 
proof. 


We remark that it is not true in general that C® is a fundamental matrix of 
(3.2.14). 


Theorem 3.2.6. [f ® is a fundamental matrix of (3.2.14) on an interval I, then ®c 
solves (3.2.14) on I for every n x | constant vector c. 


Proof. Let ® be a fundamental matrix of (3.2.14) on 7. Then 


(@c) = 0'c = (A(t) ®)c = A(t)(®c). 


So @c solves (3.2.14). 


Theorem 3.2.7. If ®(t) is a fundamental matrix of (3.2.14) on an interval I, then 
®(t)c with c= ®~!(to)xo is a solution of (3.2.14) with x (to) = xo. 


Proof. First, ®~'(t9) exists by the definition of a fundamental matrix. Hence by 
Theorem 3.2.6 x(t) = ®(t)®~!(t9)x9 solves (3.2.14). Moreover, x(to) = ®(to) x 
®~!(t)x9 = 1x9 = Xo. This completes the proof. 


3.2.2 x’ = Ax 
Now we consider homogeneous systems with constant matrices. In particular, we 
look at 


x'(t) = Ax(t), 399) 


where A is ann Xx n constant matrix. The fundamental solution of (3.2.22) can be 
constructed from a knowledge of the eigenvalues and eigenvectors of A. We begin 
with the following definition. 


Definition 3.2.7. Let A be ann x n constant matrix, shortly, a “matrix.” A number A 
is said to be an eigenvalue of A if there exists a nonzero vector v such that 


Av=)uv. (3.2.23) 


Copyright Elsevier 2022 


a 


78 CHAPTER 3 Systems of 


ordinary differential equations 


The solution vector v is said to be an eigenvector corresponding to the eigenvalue i. 
We may refer to 4 and v as an eigenpair. 


Now consider a solution x 


of (3.2.22) of the form 


x(t) = ve" 


for v € R” and A € R. Then we have 


or 


(A—ADv 


Ave = Ave”, 


= 0 if and only if det(A — AJ) = 0. 


Thus we have the following straightforward result. 


Theorem 3.2.8. [f 20, vg is an eigenpair of A, then 


is a solution of x' = Ax. 


x(t) = e*' vg = pe 


Proof, Let x(t) = e+ vp. Then 


x(t)= doe up = Aguge*! = Avge! = Ae* vg = Ax, 


as desired. This completes the proof. 


Theorem 3.2.9. (Independent eigenvectors) Let v\,02,...,Up be the correspond- 
ing eigenvectors to the distinct eigenvalues )|,A2,...,4p» of a matrix A. Then 
UV], V2,..., Up are linearly independent. 


Proof. Suppose v1, v2,..., vj are linearly independent for positive integer j. If 
j < p, then vj+1 can be written as a linear combination of the vectors v1, v2,..., v;, 


that is, there are constants cy, 


C2, +++ Cj such that 


Vj+1 SCV] + C2U2 + +++ + CjU;. 


Multiply from the left by the matrix A and apply the fact that Av; = A;v; for i = 


1,2,... 7 to arrive at 


Avj+i =Aj4 
=Aj4 


H1Uj+1 
Li(civy + c2v2 +...+ cjv;) 


= CiAj41U1 +020 j4102 +... + CjAj410;. 
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On the other hand, 


AvjH= A(civ1 +cquvg2+...+ cjv;) 
=cyjAvjy +c2Av2+...4+ cj Av; 
= cA + c2AQU2 +... + CjAj0;. 


Subtracting the two equations gives 
c1(Aj+1 — Aiur + c2(Ajgi — Az)u2 +... Fj (Ajgi — Aj); =0. 
Since vj, v2,..., uj; are linearly independent, we must have that 
cy(Ajz1 —A1) = 0, c2(Ajz1 —A2) =0, ..., CF AFI — Aj) =O. 
Since 
Ajti—Aj #0, forall j=1,2,...,n, 
this could only be possible if 
cl =c2,...,c; =0. 


This implies that 
vj4+1 =0 (Zero vector), 


which is a contradiction, since vj+1 is the eigenvector corresponding to 4 j+1. This 
completes the proof. 


As a result of Definition 3.2.4, Corollary 3.2, and Theorem 3.2.9, we have the 
following theorem concerning systems with constant matrices such as (3.2.22). 


Theorem 3.2.10. (Distinct eigenvalues) Let 41, 42,...,4n be n distinct real eigen- 
values of the matrix A of (3.2.22), and let K\, K2,..., Kn be the corresponding 
eigenvectors. Then the general solution of (3.2.22) on the interval I = (—o0, o&) is 
given by 


x(t) = c Kye"! + co Kye"! , ee en Kner! 
for constants cj,i=1,2,...,n. 
Remark 3.2. Tf we let 
$j = Kje*', i=1,2,...,n, 


then the fundamental matrix ® of (3.2.22) is formed by taking its columns to be 


&=[¢1(t), ¢2(0),-.-, dn]. 
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Example 3.6. (Distinct eigenvalues) Consider the linear system 


—-4 1 #1 xX] 
x=] 1 5 -1 x2 
0 1 -3 X3 


Then the eigenpairs are given by 


1 10 1 
A, =—3,K,=|]0], A.=—-4, Ko=]-1], 143=5,K3=] 8], 
1 1 1 


and hence the general solution can be written as 


1 10 1 
x(t) =c, | 0 eo +co]|-1l ae ie 8] er. 
1 1 1 


Moreover, the fundamental matrix ®(f) is given by 


eot 10e—* et 
O(t)=] O -e** Ber]. (3.2.24) 


e e e 


Now suppose we impose that every solution satisfies the initial condition 


X01 
X(to) -= x0 = | X02 
X03 


Then by Theorem 3.2.7, the unique solution is 
x(t) = O(1)®""(1o)x0, 
where ®(f) is given by (3.2.24). 


Next, we discuss repeated roots. For example, the system 


,_ (3 —18)\ (x1 
x = a) & (3.2.25) 


has the repeated eigenvalue 1; = Az = —3. If Kj = (2 ) is the corresponding eigen- 
vector, then we have the two equations 6k, — 18k. = 0, 2k; — 6k2 = 0, which are both 


equivalent to kj = 3k2. As a consequence, we have the single eigenvector K; = Ge 


1 
g= (7) a 


and so one solution is given by 
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Since we are interested in finding the general solution, we need to examine the ques- 
tion of finding another solution. 

In general, if m is a positive integer and (A — 41)” is a factor of the characteristic 
equation det(A — AJ) = 0, whereas (A — 2 1)"*! is not a factor, then A, is said to be 
an eigenvalue of multiplicity m. We discuss two such scenarios: 


(a) For some n x n matrix A, it may be possible to find m linearly independent 


eigenvectors K,, K2,..., Kn corresponding to an eigenvalue 4, of multiplicity 
m <n. In this case the general solution of the system contains the linear combi- 
nation 


cy Kye" + 0) Kye! +...4 cnKne. 


(b) If there is one eigenvector corresponding to an eigenvalue of multiplicity m, then 
we can find m linearly independent solutions of the form 


b= Kye," 


oo = Ky te™" + Kye*", 


m—1 t- 2 
om = Kt —$—<——¢"# + Kn.—e"™ + Kune, 
(m — 1)! (m — 2)! 
where K;; are column vectors, known as generalized eigenvectors. For an illustration 
of case (b), we suppose A, is an eigenvalue of multiplicity two with only one corre- 
sponding eigenvector. To find the second eigenvector, in general, we assume a second 
solution of 


x’ = Ax 
of the form 
oo(t) = Kte™!! + Per", (3.2.26) 

where 

Pi ky 

P2 ky 

P= and K = 
Pn kn 


are to be found. Differentiate $2 (rt) and substitute back into x’ = Ax to get 
(AK —4,K)te*"! + (AP —A,P — K)e*" =0. 
Since this equation must hold for all t, we have 


(A—A,1)K =0 (3.2.27) 


Copyright Elsevier 2022 


a 


82 CHAPTER 3 Systems of ordinary differential equations 


and 
(A-A,DP=K. (3.2.28) 


Eq. (3.2.27) implies that K must be an eigenvector of A associated with the eigen- 
value A,, and hence we have one solution ¢1 (t) = Ke*!". To find the second solution 
given by (3.2.26), we must solve for the vector P in (3.2.28). Now we go back to find- 


ing a second solution for (3.2.24). We already know K given by Kj. Let P= G ; ). 


P2 
Then from (3.2.28) we have (A + 3/) P = K, which implies that 6p; — 18p2 = 3 or 
2p, — 6p2 = 1. Since these two equations are equivalent, we may choose p; = | and 
find p2 = 1/6. However, for simplicity, we choose p; = 1/2, so that p2 = 0. Using 


(3.2.26), we find that 
or(t) = (;) te~>" a Co) et, 


Thus the general solution is 


x(t) =cigi(t) + erga(t) = c1 (;) e+ ef @ te 4 (‘"") ee), 


Moreover, the fundamental matrix ®(f) is given by 


3e-%*  3¢e 9 4 Let 
n= 2 ) 


et tet 
3.2.3 Exponential matrix e4¢ 


In the previous section we looked at the concept of a fundamental matrix ®(t) for 
the linear system x(t) = A(t)x(t) and applied it only to constant matrices. In this 
section we study in detail such constant matrices; namely, we consider 


x'(t) = Ax(t), x(to) = xo, (3.2.29) 
where A is ann X n constant matrix, and x € R”. Note that 
\|Ax — Ay|| < K||x — yll, 


where K > 0 is constant, and || - || is the matrix norm of A defined by 


|Ax| 
JAll= sup 
xeR"—(0} [| 
Then by Picard’s theorem (Theorem 3.1.2) there exists a solution on the interval 
|t — to| < h for x9 : [—h, h] — R”. We may define Picard’s iteration by 


t 


Ems: i Axn(s)ds, xo(t) = x0, (3.2.30) 


1 
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with the understanding that 


xi = (G1, 0), ...,.64)7, i=1,2,...,7, 


where oi ER", j =1,2,...,n. Setting n = 0 in (3.2.30), we get 


t 
XxX, =xXot+ / Axods = x9 + (t — to) Axo. 
f 


0 
Similarly, for = 1, we have 


t 


t 
n= f Axi(o)ds= 0+ | A(s — to) Axods 
10 


19 


¢— i)" 
= x0 + (t — 9) Axo + aw (2 


Using an induction argument, we arrive at 


fi)? t — to)" 
Xn = Xo + (t — to) Axo + CoO Axo SPesia SE CaO ax 
n k 
t—t 
= Dy ie) yh. 
k! 
k=0 
Letting n + oo, we have 
x(t) = e4F-) x9, (3.2.31) 
where 
(oe) 
t — to)” 
eAt—0) — \ eo) ay A". (3.2.32) 
n! 
n=0 


It readily follows from the ratio test that the infinite series in (3.2.32) converges abso- 
lutely for all t — to € R. Thus e4¢—"0) exists for all times. Note that the infinite series 
given by (3.2.32) can be differentiated term by term, and hence 


d aq = (t — to)” 

(t—to) _ n 

—e =A ) n————_A 
| 

dt i n! 


ioe) = 
(t— to)" : n—-1 
(n— 1)! 
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o k 
(t — to) k 
a a 
k=0 


AeAG 0), 


This shows that if 
x(t)= eAl—0) x4, 
then x(t) satisfies x’ = Ax. Moreover, 


A(t—to) (t — t)? 
x(t) = At xo = [1+ @— A+ 


AP+ + CoN at todo 
and hence 

X(to) = 1x9 = x0. 
We have the following definition. 
Definition 3.2.8. Let A be ann x n constant matrix. Then we define the exponential 
matrix function by e4¢—"), which is the solution of x’ = Ax, and e4© = J (identity 
matrix). 

Thus we have already proved that 

x(t) = e480) xo (3.2.33) 

is the unique solution of 
x'(t)= Ax(t), x(t0) = Xo, 

for allt € R. 


Example 3.7. Consider the system 


6 )0)-0-() 


Then the matrix A is diagonal and given by 


A=(5 a 


Since A is a diagonal matrix, by induction we can easily show that 


n_(3" 0 a 
A = Can) tebe 
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Hence 
tA)? tA)" 
pada § Vt : 
n! 
2: n 
14 2%4 00 4...4 08 0 
= —¢)2 _+)n 
0 14584 5% 4... 4.0% 


We deduce from the exponential function properties that the exponential matrix e4’ 


is given by 


and the solution is 


3t 2 
imecroe(® 2)(3) 


In the next theorem we list some properties of the exponential matrix. For sim- 
plicity, we start at the initial time zero, that is, we take f9 = 0. We are concerned 
with 


x’ = Ax, (3.2.34) 


where A is ann X n constant matrix, and x € R”. 


Theorem 3.2.11. Let A and B ben x n constant matrices. Then: 


d 
(1) a = Ae“, t ER; 
(2) det(e4’) £0, t ER, and e*' is a fundamental matrix solution for (3.2.34); 
(3) eA’ = 1+ Att (At)? + f(ANP +--+ A(ADE +++; 
(4) eAteds — eACTS) ¢ seR; 
-1 
(5) (c*’) 2 eT“. 
(6) If AB = BA, then e“' B = Be*'; 
(7) If AB = BA, then eA‘ ce?! = eAt8) ¢ ER; 


(8) If P is a nonsingular matrix, then eP BP! _ peB p-), 


Proof. The proof of (1) is already done. For (2), we already know that e4’ solves 
(3.2.34). Moreover, at t = 0, e4’ = J, and hence det(e4°) = det(1) 4 0. By the 


uniqueness of solution this must hold for all t € R. Now since e“ solves (3.2.34), 
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we have that e4’ is a fundamental matrix for (3.2.34). The proof of (3) is already 


done. For (4), we let L(t) = e4'e4 — eA), where s € R is fixed, and f € R. Then 
L(tj= Ae“ eA5 — AeAtts) — A(eMte” = ee) 


or L’(t) = AL(t), from which we conclude that L(t) solves (3.2.34). On the other 
hand, L(0) = e4’ — e4’ = 0, and hence by the uniqueness of solutions we get that 
L(t) = 0 for all t € R. This completes the proof of (4). 

By the proof of (4), we have that 


edt At _ pAt-At _ ,A+(-1) _ op 


This implies that 


=i 
(e*’) =e“ teR. 
Remark 3.3. In the case where A is ann x n constant matrix, the exponential matrix 
is equivalent to 
et) = O(1)O"" (10), 
which is the principal matrix. 


Next, we discuss an important topic that relies on the Jordan canonical form, 
which helps us find the exponential matrix e4’. The next theorem is well known in 
linear algebra, and you may consult Brauer and Nohel [17] for its proof. 


Theorem 3.2.12. (Jordan canonical form) For every n x n matrix A, we can con- 
struct a matrix C such that 


J, 0 0 
clac=|9 2 9 +]. (3.2.35) 
0 0 Ik 
where 
Jp = Al + Nx 
with 
01 0 0 0 O 
00 1 0 0 0 
Nx = . a 
0000... 0 1 
000 0 .::. 0 
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Remark 3.4. (The simplest case) If A has n real and distinct eigenvalues Aj, A2, 
...,An, then the matrix C7! AC will bea diagonal matrix with entries 4;, that is, 


Ay OU ee 0 
ciac-|° * 
0 O ax 


In this case the matrix C is formed from the corresponding eigenvectors of the ma- 
trix A. 


If (3.2.35) holds, then let 
B=C"'AC, 
and hence 


=i = 
eA = etCcBC =ce8c 7 


In Section 3.2.1, we encountered different scenarios on the type and nature of 
the eigenvalues when computing the eigenvectors. The next result, called Putzer al- 
gorithm, allows us to find the fundamental matrix or, in particular, the exponential 
matrix e“’ when the matrix is constant, regardless of the order or multiplicities of the 
eigenvalues. Putzer’s algorithm depends on the next theorem, known as the Cayley— 
Hamilton theorem. 


Theorem 3.2.13. (Cayley—Hamilton) Every n x n constant matrix satisfies its char- 
acteristic equation 


pa(A) := det(A — AT) = 0. 
In other words, if 
pa) =(-D"(a" +e" $e bend ten), 
then 
pa(A) = (-1)"(a" + cy A"! tees + en] A+ cnt) = 0. 


Theorem 3.2.14. (Putzer algorithm) Suppose A is an n x n constant matrix with 
eigenvalues hj, 2,...,An, which may come in any order or multiplicities. Suppose 
Mi(t), M2(t),..., Un(t) satisfy the corresponding initial value problems 


By =A, MO =1; Wj =Ajuy + uj, MjO =O, §=2,3,....0. 
(3.2.36) 
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Let the matrices Pp, P,,..., Py be defined recursively by 
j 
Py=t, Pp= | [A—2e);. f= 12.4,01. (3.2.37) 
k=1 
Then 
n—-1 
eh >) OP; (3.2.38) 
j=0 
Proof. Let 
n-1 
O(1) = D0 ej (Pj. 
j=0 
Then 


n—1 
(0) = > ji )P; 
j=0 
= 111 (0) Po) + 12(0) Pi (0) +... + Un (0) Pn—1 (0) 
= 1(0) Po(0) +0+...+0 (by (.2.36)) 
= 1 (0)1 =I (by (3.2.37). 


Next, we differentiate © with respect to ¢: 


n—-1 
@'() => wi OP; 
j=0 
n—-1 
=ApiPot > ui OP), by B.2.36)) 
j=l 


n—-1 


= Ami Po+ Y Ajsimjsitmy)Pj, (by B.2.36)). (3.2.39) 
j=l 
On the other hand, 
n—1 
A®=)0 nj41OAPj. 
j=0 


From (3.2.37) we have 


ji j-l 
Pj) =|] [Aad =(A-AD[ [A-Ad = (A-ADPj-1. 
k=1 k=1 
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This implies that 
AP; = Pyar tajqiPj), f=12,...n—-1. 
Substituting AP; into A® in the above expression yields 


n—1 
A® = J) jp OUP ji + Ajsil Pil, 
j=0 


A®=dAjpi(t)Po + Azua(t) + wit) Pit... 
+ Anbn(t) + Mn—1(@)) Pa-1 + ent) Pr. 


By the Cayley—Hamilton theorem P, = 0, and hence the last expression of A® is 
the same as the right side of (3.2.39) so that we have ®’(t) = A®(t) with ®(0) = /. 
Thus expression (3.2.38) holds by the uniqueness of the solution. This completes the 
proof. 


Example 3.8. Consider the linear system 


satisfying the initial condition 


x(0) := x9 =] —-1 


The matrix 
2, 2 —-1 
A={2 -1 2 
-1 2 2 


has the eigenvalues 3, 3, —3. We may order them arbitrarily. Let, for example, 41 = 3, 
A2 = 3, and A3 = —3. Using (3.2.37) with j = 1, 2, we see that 


Po=1, Pj =A—3I, Py =(A—3I)’. 
Similarly, by (3.2.36) 


Hy = 3441, 110) = 1; 
Hy = 32 + w1(0), M2(0) =0; 
(3 = —33 + 2(t), 43(0) =0. 
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Solving the above initial value problems gives 


(t)=e*, po(t)=te*, and pa(t)= Lees + — 
M1 = » M2 = ’ M3 _ SE 36 36 : 
By using (3.2.38) with n = 3, we obtain 
2 
eM = jt (OP; = m1 Po + wo Pi + u3 Po, 
j=0 


and the unique solution is given by 
x(t) = et xo. 


Example 3.9. Assume we have three masses m1, m2, and m3 that are connected to 
each other by four springs with spring constants kj, k2, k3, and k4, respectively. As 
seen in Fig. 3.2, the first and last springs are attached to two fixed walls, and the 
masses slide along a frictionless horizontal surface. Displacement of the masses from 
their equilibrium positions is determined by the coordinates x, y, and z, each positive 
to the right. The motion of the masses depends strongly on the initial conditions, that 
is, by hand, any of the masses is displaced by pulling forward or backward, and we 
let them go. Next, we attempt to find the equations of motion. The springs operate 
according to Hooke’s law: Force = spring constant multiplied by elongation. The 
springs restore after compression and extension. In addition, the first three springs 
are elongated by x, y — x, z — y, respectively. Then using Newton’s second law, 
Force = sum of the Hooke forces, we arrive at the system of second-order differential 
equations 


mx" (t) = —kx(t) + kaLy(t) — x(0)], 
m2y" (t) = —kaly(t) — x] + ka[z@) — yO], 
m32z" (t) = —k3[z(t) — y(t)] — kaz(t). (3.2.40) 


System (3.2.40) can be written as a second-order vector—matrix system 
Mx" (t) = Ax(t), 


where the displacement x, mass matrix M, and stiffness matrix A are given by 


x my 0 0 —k, —k kp 0 
x=|fy], M=] 0 m Of, A= ko —k2 —k3 k3 
z 0) 0 m3 0 k3 —k; = K4 
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FIGURE 3.2 


Three masses connected by four springs. 


FIGURE 3.3 


Three identical boxcars connected by identical springs. 


Set my = m2 = m3 = 1, kj = 2, kn = 1, k3 = 1, and kq = 2 in the second-order 
vector—matrix system 


Mx" (t) = Ax(t). 


Then using Putzer’s algorithm, we find the solution 


x 1 
y | = (ai cos(t) + by sin(t)) | 2 
Zz 1 
I 
+ (az cos(V3t) + b sin(V3t)) | 0 
-1 
1 
+ (a3 cos(2r) + b3 sin(2r)) | —1], 
1 


where a1, a2, b}, bz, a3, and b3 are arbitrary constants. 


Example 3.10. (Boxcars) A special case of mass-spring system is boxcars. In Fig. 3.3 
we assume three identical boxcars on a level track connected by two identical springs. 
Excepts for the springs on fixed ends, this problem is the same as in Example 3.9. 
With this in mind, we have that kj = k4 = 0 and kx = k3 = k. In addition, my = m2 = 
m3 =m. Consequently, we arrive at the system 


Mx" (t) = Ax(t), 


Copyright Elsevier 2022 


Me 
92 CHAPTER 3 Systems of ordinary differential equations 


where the displacement x, mass matrix M, and stiffness matrix A are given by 


x m 0 O —-k ok 0 
x=|[y}], M=|0 m Of}, A=|[ kK —-2k k 
z 0 O m 0 kk —k 


-! 1 0 
x’={ 1 —2 1 Ix, 
1 -l 
which has the vector solution 
x 1 
yjJ= (a + bit) 1 
Zz 1 
1 
+ (a2 cos(t) + b2 sin(t)) 0 
—1 
1 
+ (a3 cos(/3r) + b3 sin(V3r)) | —2 ], 
1 
where a1, a2, a3, bj, b2, and b3 are arbitrary constants. 
3.3 x’ =A(t)x + g(t) 
Now we consider the non-homogeneous system 
x’ = A(t)x + g(t), (3.3.1) 


where A(t) is ann xX n matrix, and g(t) is ann x | vector, both continuous on some 
interval J. It was proven in Theorem 3.2.1 that system (3.3.1) has a unique solution on 
T if an initial condition is specified for to € 7. We are interested in finding the general 
solution of the non-homogeneous system (3.3.1). With the non-homogeneous system 
we associate the complementary homogeneous system 


x= A(x. (3.3.2) 


Knowing the solution of (3.3.2) is enough to find the general solution of (3.3.1), and 
such a solution will be given by the variation of parameters formula. 
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Definition 3.3.1. Let x; be the homogeneous solution of (3.3.2), and let x, be the 
particular solution of (3.3.1) on an interval J. Then the general solution x : J > R” 
of (3.3.1) on the interval J is given by 


x(t) =xn(t) +.2p(). 


We have seen that if ® is the fundamental matrix of the homogeneous system 
(3.3.2), then x, = ®(t)k for some constant n x 1 vector k. 


Theorem 3.3.1. Let A(t) be ann x n matrix, and let g(t) be ann x 1 vector, both 
continuous on some interval I. Suppose ® is the fundamental matrix of the homoge- 
neous system (3.3.2). Then x(t) is a solution of 


x’ = A(t)x + g(t), x(to) = x0, t= to, (3.3.3) 


on I if and only if x satisfies 


£ 
x(t) = oO "o)x0 + f @(t)d~!(s)e(s)ds, (3.3.4) 


fo 
where to € I and xo € R”. 


Proof. First, note that the uniqueness of the solution of (3.3.3) follows from The- 
orem 3.2.1. Let ® be the fundamental matrix of the homogeneous system (3.3.2). 
Suppose x satisfies (3.3.4). Taking the derivative in ¢ in (3.3.4) gives 


t 
x(t) = &'(t)O7! (to) xo + O' (1) i 7 '(s)g(s)ds + B(t)O! (t) g(t) 
to 
ik 
= A(t) ®(t)O7! (to) x9 + AN O(0) f 7 '(s)g(s)ds + g(t) 
i) 


t 
= ADO)" 0)x0 + OW) / 7's) g(s)ds] + g(0) 
10 
= A(t)x() + 8(0). 


Finally, replacing ¢ by fo in (3.3.4) gives x (to) = [xo = xo. Now let x(t) be the unique 
solution of (3.3.3), and let us show that it satisfies (3.3.4). As we have mentioned ear- 
lier, x, = @(t)k for some constant n x 1 vector k. To derive the particular solution x p, 
we look for a particular solution of the form 


xp(t) = (u(t) 


for some continuous function u on J. Differentiating x, and plugging back into 
(3.3.3), we have 


ce = O'(t)u(t) + O(t)u' (t) 
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or 
O'(t)u(t) + O@)u'(t) = A) P (u(t) + gC). 
Since 
O'(t) = A) O(N), 
the above expression reduces to 
P(t)u'(t) = g(t). 
Multiplying the above expression by ®~!(t) from the left, we getu'(th= ®1(r) g(t) 
or u(t) = a a (s)g(s)ds. Finally, the equality x p(t) = @(t)u(t) gives 


10 
t 
xp =o [ &—!(s)g(s)ds. 
i) 


It follows that the general solution is 


t 

x(t) =xn(t) +xp(t) = O(DK + / B(t)O~!(s)g(s)ds. G3.5) 
10 

Using the initial condition in (3.3.5), we get 


x9 = P(to)k +0 


or 


k= ®7!(to)xo. 


A substitution of k into (3.3.5) gives (3.3.4). This completes the proof. 


Eq. (3.3.4) is called the variation of parameters formula. 


Remark 3.5. In the case where A is ann x n constant matrix the exponential matrix 
is equivalent to 


et) = O(1)O"" (10), 
which is the principal matrix. In this case, (3.3.4) reduces to or takes the form 
t 
x(t) = e4-) x9 + / eAl—5) o(s)ds. (3.3.6) 
to 


Example 3.11. Solve 
t= A DV og —15te~7! @=(7 
PNB AUP Mate PO NB 
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Using Putzer’s algorithm, we find that 


a ( et +. et a) 
e : 


7 —3e72 4.305 e728 4 et 


Note that e4° = 7. Using formula (3.3.6), we have 
1 et + 6e>% —2e~2t as ert 7 

x(t) == 
7 \ 36-2! 4 3¢5¢ 6e72t 4 et 3 


+f e725) 4 Ge t—-5) 2672-5) 4 De5t-s) —15se725 4 
to 7 —3e720-9) 4 395 s) 6e 2(t S) 4 elt s) —Ase725 ‘i 


wt ( (6 + 281 — 717)e~7! + 92e 


14 \ (—4 + 141 + 211?)e77! + 460% 


3.4 Discussion 


When the matrix A is not constant and we wish to compute the fundamental matrix 
of the system 


x= A(x, (3.4.1) 


where A(f) is ann x n matrix with continuous components on some interval J, then 
the Putzer algorithm will not help much. Suppose we are able to find two matrices A 
and S$ such that 


A=SAS7!. (3.4.2) 
Then we claim that also 
gases (3.4.3) 


for all t. To prove the claim, we use (3.2.32). As a consequence of (3.4.2), we have 
that At = S(Art)S~!, and hence 


(At)* = (S(At)S)(S(ADS)... (SCAt)S~!). 
Using (3.2.32) with to = 0, we get 
At 1 2 1 3 1 k 
eo =I + Att x(Aty + e(At +... + TCAD +... 


= =i. 4. 1 2o-1,, 1 30-1 all ko-l 
= 1+ S(ANS™' + 5S(AN?S™! + ES(ANP ST! +... + FS(ANEST! +... 
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1 Bias 4 3 1 k -1 
= S[I+At+ 5 (AN) + gan ete pho +...]S 
— Sedts—! , 
as claimed. Thus we state the general theorem. 


Theorem 3.4.1. For every n x n matrix A with entries in complex numbers, we can 
find an invertible matrix S and an upper triangular matrix A such that (3.4.2) holds. 


Another point of discussion is that if we integrate (3.4.1) from fo to t, then we get 
t 
x(t) = e044 Now let 


bq ent (3.4.4) 


For ®(f) to be fundamental matrix solution, we must have 


A( [ Acas) = ([ A(s)ds)AQ). (3.4.5) 
0 


10) 


Let us see why. Let J = i, A(s)ds. Then 


1 
ee 


1 
aa, 


1 4 
ef =T4+JI4+ are Ta 


2! 


and 


d f'asyjds_ d t 1 ft 3 
ae 0 = slit f A(s)ds + nf, A(s)ds) 
1 t k-1 1 t k 
a an reanieh A(s)ds) otal A(s)ds) +...) 
1 7 2 
“meh A(s)ds aa+=(f A(s)ds) A(t) 
iW) i to 
1 i k-1 1 t k 
AF ck neh A(s)ds) oral A(s)ds) Alt) Fasc 
1 2 
=[7+ +f Aas + 5( [ A(s)ds) ze 
1 t _ 1 t k 
+ Gp! men A(s)ds). 40+ 5(f A(s)ds) +... ]A(0) 


wala 2 
zat [ Ads + 55( [ A(s)ds) 


1 : k-1 1 t k 
Gea mel A(s)ds) aota(f Ads) +...] 


= A(t) P(t). 
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Thus if (3.4.5) holds, then ®’(t) = A(t) ®(t). We have the following application of 
the above discussion. 


Example 3.12. Find the fundamental matrix ®(f) for the system 


Let 


and 


B(t) = eho AAs, 


Now we verify condition (3.4.5): 


: , LP Periz 3/2 
aw [ Agyds= (1 4 ae / (a 
fo t UW \/2 + 32. far 
On the other hand, 
t t 7/2 t+13/2  312/2 
(/ A(s)ds)AO = / (; ‘| afer 12 \ 
to 7/2 ¢ f\t 1 ar 2 ta 2 
The matrix ‘i A(t)dt has the eigenvalues 


t? 1? 
Ay =tt+— and Ap=t- ~. 
: 2 ; 2 


Luckily, the corresponding eigenvectors are independent of t. The eigenpairs are 


1 —1 
maki = (1): ia, Ka ( I 7 


Let 


Then the inverse of H is 
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As consequence of (3.4.3), we get the exponential matrix of J, 


We can now calculate the fundamental matrix ® (ft): 


t 
@(t) = eln AO — Fe) AO! 


2 2 2 2 
eb feT+e 2 et—e2 
=H 2 2 2 2 


3.5 Exercises 


Exercise 3.1. Find the region of existence of the following system and then find the 
maximal interval of existence: 


ge" 
Li 25? 
a5 
Xb =1, 
x4= = 
3= > 
x9 
with initial vector 
1 
x1(>) -l 
1y)J—] 1 
x2(=) —~Ir 
1 
x3(4) : 
Exercise 3.2. Show that ||A||; is a norm, that is, verify all the items in Defini- 


tion 3.2.2. 


Exercise 3.3. Show that if A is ann x n invertible matrix, then 
-1 1 
[|Al| > 0, and ||A™"|| > —_. 
|All 
Exercise 3.4. Suppose ann x n matrix A(t) and ann x | vector g(t) are continuous 
on—cw <t< 02, f |A(t)|dt < ~, and [ |g(t)|dt < oo. Show that the solution 
—oo —0o 

p(t) of y(t) = A(t) y(t) + g(t), exists for —oo < t < oo. In addition, compute the 
upper bound for |@(t)| on —co <t < ow. 
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Exercise 3.5. In Example 3.4 keep the norm of the matrix A as a function of ¢ and 
obtain a slightly better estimate of the error. 


Exercise 3.6. Prove that every solution of 
ie tx = a 
exists for all t € R. 
Exercise 3.7. Use the method of energy function to show that the solutions 
x" + cos*(x)x’ — sin?(x) = 0 
exist for all times, that is, the maximal interval of existence is [0, co). 
Exercise 3.8. Obtain two iterations of the 3 x 3 linear system 


x; (t) = 5x1 — x2, 
x5 (t) = —5x2 + 9x3, 
x3(t) = —5x1 — Xo, 


with the initial condition 


X01 1 
x(0) = x0 = [| X02 | = —l 
X03 0 


Exercise 3.9. Use Theorem 3.2.10 to solve, for all t > fo, the linear system 


1 -1 2 xX] 
x=] -1 1 O x2 
-1 0 1 X3 


with initial condition 
1 
X(to) := x9 = | 0 
2, 


Exercise 3.10. Use Theorem 3.2.10 to solve the linear system with the initial condi- 


tion 
1 -12 —-14 x] 4 
x =]1 2 —3 x2), x(0)=xo:=] 6 
1 1 —2 x3 —7 


Exercise 3.11. (a) Let 
x'(t) = Ax(t), 
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where A is a constant n x n matrix. Suppose A has only one eigenvector K 
associated with an eigenvalue A; of multiplicity three. We can find a second 
solution of the form (3.2.26), where the eigenvector P satisfies (3.2.28). Show 
that if we assume a third solution ¢3(t) of the form 


2 
t 
$3(t) = K>eN + Pte’ + Qe, 


then the vector Q is given by the equation 
(A-ANOQ=P. 


(b) Find the fundamental matrix for the linear system 


1 0 0 xX] 
x =12 2 -1 x2 
0 1 =O x3 


Exercise 3.12. (a) Let 
Uy =AL@, 


where A is ann x n constant matrix with real entries. Let K be an eigenvector 
corresponding to the complex eigenvalue 1; = a + if (with real a and 8). Show 
that the corresponding two linearly independent solutions ¢(t) and @2(t) are 
given by 


fi(t) = (Re(K) cos(Bt) — Im(K) sin(Bt) )e* 
and 


piN= (Im(K) cos(Bt) + Re(K) sin(Br)) ew, 


For example, if K = e ); then 


1 0 
Ka (5) ae i = Re(K) +Im(K). 


(b) Find the fundamental matrix for the linear system 


a 1 2\ (x1 
ft 5 1) \x2)° 


Exercise 3.13. Let ® be a fundamental matrix of x’ = Ax, and let C be a nonsingular 
matrix with AC = CA. Prove that now C@® is a fundamental matrix of x’ = Ax. (See 
Theorem 3.2.5.) 


Exercise 3.14. Prove parts (5), (6), and (7) of Theorem 3.2.11. 
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Exercise 3.15. Finish the calculation in Example 3.8 and show that 
At Pe 
e =cosh(3t)I + 3 sinh(3t)A. 


Exercise 3.16. Use Theorem 3.2.14 to compute e“’ for 


(a) 
2 0 0 
A=|]1 2 O}], 
1 0 3 
(b) 
5 -4 0 
A=|{1 0 2 
0 2 5 


Exercise 3.17. Use Theorem 3.2.14 to compute e“’ for 


—-1 —2 2 x] 
x=] 3 5 -3 x2 
3 4 -—-2 x3 


satisfying the initial condition 


1 
x(0) =x9o:= | -1 
1 


Exercise 3.18. Consider two non-homogeneous systems x’ = Ax + gi(t) and x’ = 
Ax + g2(t) with solutions z; and z2, respectively. Let g(t) = g1(t) + g2(t). Show 
that z} + z2 solves x’ = Ax + g(t). Here g1, go are n x | vector functions that are 
continuous on R. 


Exercise 3.19. Use the variation of parameters formula to solve the given system 
subject to the indicated initial condition. 


(a) 
1 1.0 e 0 
Y®O=f1 1 Obx+] ec 1, xm= 11), 
0 0 3 ret 
(b) 
e 7 <1 0 1 
¢@=l1 1 -1)44] + |, x@m=l2 
a rel 0 
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Exercise 3.20. Imitate the proof that leads to the variation of parameters formula 
(1.5.2) for non-homogeneous scalar differential equations to derive (3.3.6) for the 
non-homogeneous system 


x'(t) = Ax(t) + g(t), x (to) =o, 
where A is ann x n constant matrix, and g is continuous on some interval J. 


Exercise 3.21. Find the fundamental matrix ®(f) for the system 


Exercise 3.22. Assume the fundamental matrix ®(r) of a certain 2 x 2 differential 


system is given by 
ee 2 ¢ 
“he 


Find the corresponding system of differential equations. 


Exercise 3.23. Write the system 


x =—-xy+ xe", x4 =—X2 
in the form of 
x'(t) = A(t)x(t). 


Compute the eigenvalues of A(t) and then find the solution of the system. Are solu- 
tions bounded or unbounded? 


Copyright Elsevier 2022 


CHAPTER 


Stability of linear systems 


We look at the stability of linear systems via the variation of parameters. The chap- 
ter also includes a nice section on Floquet theory with its application to Mathieu’s 
equation. 


4.1 Definitions and examples 


Consider the scalar differential equation 
x’=ax, t>0, (4.1.1) 


for constant a. Then (4.1.1) has a solution x(t) = Ce“ for every constant C. Note 
that x(t) = 0 is a solution of (4.1.1) since it satisfies both sides of the equation. It is 
clear that solutions go to infinity for a > 0 and decay to zero for a < 0 as t — ow. 
Thus the behavior of the solutions depends on the sign of the constant a. It seems that 
the solution x = 0 is an attractor asymptotically stable in the case a < 0, which we 
will discuss in detail in this chapter. 

Notice that if a = 0, then solutions are constants. Thus if we start near the zero 
solution x = 0, then we stay near the zero solution, and hence the zero solution is 
stable but not asymptotically stable. 

In the above example, we were able to find the solution. However, this is not the 
case for the nonlinear differential equation 


x(x — 1)(x +2) 


age 


,t>0, x(0) = x0. (4.1.2) 


Eq. (4.1.2) is nonlinear, and the true solution cannot be explicitly found. On the other 
hand, we notice that x = —2, 0, | are all constant solutions or equilibrium solutions of 
(4.1.2). However, we can use calculus to analyze those constant solutions. Note that 
the right side of (4.1.2) is continuous on R, and hence a solution exists for all t > 0. 
Moreover, any solution passing through (fo, xo) is unique. For the next discussion, 
we refer the reader to Fig. 4.1. 


(a) For x < —2, we have from (4.1.2) that x’ < 0, and hence solutions grow nega- 
tively unbounded; in particular, they pull away from the constant solution —2. 


Advanced Differential Equations. https://doi.org/10.1016/B978-0-32-399280-0.00010-3 1 03 
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Xo 


xo 


Ss 


xo 


XO 


FIGURE 4.1 


Diagram for the constant solutions. 


(b) For —2 <x < 


0, we have from (4.1.2) that x’ > 0, and hence solutions increase 


toward the constant solution x = 0 and away from the constant solution x = —2. 


(c) ForO<x <1 


, we have from (4.1.2) that x’ < 0, and hence solutions decrease 


toward the constant solution x = 0 and away from the constant solution x = 1. 
Note that in (b) and (c) solutions cannot cross the constant solution x = 0 due to 
the uniqueness. Finally, 


(d) For x > 1, we 


have from (4.1.2) that x’ > 0, and hence solutions unboundedly 


increase and away from the constant solution x = 1. 


Thus by the above 


discussion and Fig. 4.1, we see that the constant solution x = 0 


is an attractor (asymptotically stable), and the other constant solutions x = —2, | are 
repellers (unstable), which we discuss later. 


Copyright Elsevier 2022 


CCC‘ HUUOCtsé(‘(#UUCN“##UN”N”N”"»_—“= hE oo 


4.1 Definitions and examples 105 


Consider the system of ordinary differential equations 
x’ = f(t, x), (4.1.3) 


where f € C([0, oo) x D, R"), and D C R" is open. We say that a vector x* € R” is 
an equilibrium, or constant solution, or equilibrium solution of (4.1.3) if 


f(t,x*)=0, 0O<t<u, 


for positive constant w. In practice, it is easier to talk about a zero solution, or x = 0. 
To do so, we translate every nonzero equilibrium point to zero by the change of 
variables 


X(t) = x(t) — x", 


and from (4.1.3) we have that 
£OH)=G0)=27) =7 O=fGs042). 


In this case, x(t) = 0 is an equilibrium point of (4.1.3), which we may call the zero 
solution of (4.1.3). Thus, in most cases, we may require f(t, 0) = 0,0 <t < w, when 
we talk about the zero solution. 


Example 4.1. (Lotka—Volterra predator-prey model) Let x(t) and y(t) be the number 
of preys and predators at time f, respectively. To keep the model simple, we make the 
following assumptions: 

e The predator species are dependent on a single prey species as its only food supply; 
e The prey species have an unlimited food supply; and 

e There is no threat to the prey other than the specific predator. 

In the absence of predation, the prey population would grow at a natural rate: 


dx ) 0 
—_—= ,a>0. 
7 ax a 
On the other hand, in the absence of prey, the predator population would decline at a 
natural rate: 
dy 


on =-—cy(t), c>0. 


The effects of predator eating prey is an interaction rate of decline (—bxy, b > 0) 
in the prey population x and an interaction rate of growth (dxy, d > 0) of predator 
population y. Hence we obtain the predator-prey model 


d 

Gx ax — bry, 

aS d 414 
“wo xy. (4.1.4) 
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The Lotka—Volterra model consists of a system of linked differential equations that 
cannot be separated from each other and that cannot be solved in closed form. Thus 
we search for the equilibrium solutions by setting the right sides of both equations in 
(4.1.4) equal to zero, that is, 


x(a — by) =0, y(-c+dx)=0. 


From the first equation we obtain x = 0, y = a/b, and from the second equation 
we get y =0, x = c/d. Now if x = 0, then from the second equation we have that 
—cy =0, and hence y = 0. Thus we have the equilibrium solution 


x* = (0,0). 


Similarly, if y = a/b, then — 4 + dx" = 0, which implies that x = c/d. So the other 


equilibrium solution is 
x} = (c/d,a/b). 


The first equilibrium solution x} effectively represents the extinction of both 
species. If both populations are at 0, then they will continue to be so indefinitely. 
The second equilibrium solution x3 represents a fixed point at which both popula- 
tions sustain their current non-zero numbers and do so indefinitely. The levels of the 
population at which this equilibrium is achieved depend on the chosen values of the 
parameters a,b,c, and d. We further discuss the stability of both equilibrium solu- 
tions xf and x} and hope that x} is unstable. (See Fig. 4.2.) 


FIGURE 4.2 


Prey—predator dynamics as described by the level curves. The arrows describe the velocity 
and direction of solutions fora =b=c=d=1. 
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Next, we consider (4.1.3) with the initial condition x (tg) = xo with the assumption 
that f(t, 0) =0. 


Definition 4.1.1. The zero solution x = 0 of (4.1.3): 


(a) is stable (S) if for all ¢ > 0 and fo > 0, there is 5 = 5(tp, €) > O such that 
|x (to)| < 6 implies |x(t, to, x0) |<, 

(b) is uniformly stable (US) if 6 is independent of fo, 

(c) is unstable if it is not stable, 

(d) is asymptotically stable (AS) if it is stable and jim, |x(t, to, xo)| =0. 

(e) is uniformly asymptotically stable (UAS) if it is US and there exists y > 0 such 
that for each jz > 0, there exists T = T(z) > O such that |x(t)| <y,t>to+T, 
implies |x(f, to, x0)| < LU. 


There are various stability definitions that can be found in many of the referenced 
books. As far as this book is concerned, the stability definitions that we have listed are 
the most important ones. We furnish a few examples to illustrate the above definitions. 


Example 4.2. In this example we show that the zero solution is US and AS but 
not UAS. We consider the initial value problem given by 


(l—1t)x’(t) =x, x(t.) =x0, t>to> 1. 
For simplicity, we may write our problem as 


va, x(to) =x0, t>to> 1. (4.1.5) 


Separating the variables in (4.1.5), integrating from fo to t, and then applying the 
initial data, we arrive at the solution 


to —1 
x(t, fo, X0) = . 7% te t0> 1. (4.1.6) 


For any ¢ > 0, set 6 = «, so that for |xo| < 6 and t > fo > 1, we have that 


to — 1 to — 1 
bx(@, 10, x0) = |---| = | — lIxol < lxol <5 =e, 


This shows that the zero solution is US. Moreover, 


x01 =0, 


. . |to-1 
lim |x(¢, fo, xo)| = lim | 


1 


and so the zero solution is AS. On the other hand, if we evaluate the solution 


0 0 
X(t, to, x9) = Xo att =fto+T, then we get x(t9 + T, to, x9) = ———-- x) > 
(t, to, Xo) 7% 0 get x(to 0» X0) beToi” 
1 as tg > oo. This implies that |x(f, fo, xo)| < € for t > to + T. We conclude that the 
zero solution is not UAS. So this example shows that US plus AS do not necessarily 


imply UAS. 
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Example 4.3. The differential equation 
x’ =0, x(to) = x0, 
has the constant solution x(t) = xg, and hence the zero solution is US but not AS. On 
the other hand, 
t= x, x)= a0, 
has the solution x(t) = xoe’—®, and its zero solution is unstable. 


Example 4.4. The differential equation 


x =—x; xo) S20, 


has the solution 
x(t, t,.X0) =x0e“—, t > 1) = 0, 


and its zero solution is US and UAS. To see this, for any ¢ > 0, we set 6 = ¢. Then for 
|xo| < 6, we have that x(t, to, x0) | = |xoe~“— | < |xo| < ¢ =6. So the zero solution 
is US. For the UAS, we must show that there exists y > O such that for each uz > 0, 
there exists T = T(t) > O such that |x (fo)| < y,t = to+T, implies |x(t, fo, x0)| < pe. 
Set 6 = | of the uniform stability, and let y = 6 = 1. Let T(u) > —Ln(y). Then for 
t>tot+T(u), 


|x(¢, to, x0)| = lxoe | < eT < eh = p, 


This shows the zero solution is UAS. 


4.2 x'=A(t)x 
Now we are in a position to discuss the stability of the zero solution of the linear 
system 


x(t) = A(tHx(t), x(to) = x0, (4.2.1) 


where A(t) is an x n matrix with continuous entries on [0, 00), using the concept 
of the fundamental matrix. We begin with the following theorem. 


Theorem 4.2.1. Let ®(t) be the fundamental matrix of (4.2.1). Then the zero solution 
of (4.2.1) is 


(a) stable if and only if there exists a positive constant M such that 
[P@)| <M, t=O; 
(b) asymptotically stable if and only if 


|®(t)| ~ 0 as t> ~w. 
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Proof. (a) (<=) Let ®(¢) be the fundamental matrix of (4.2.1). Then the unique so- 
lution x of (4.2.1) is given by x(t) = ®(t)@~! (t9)x9. Thus for any € > 0 such that 


xo| < €, set 5 = —~*_.. Then 
es [>-T@)1M 


|x(1)| = |@()O7!(t0)x0| < |@()||O7! (to) ||xo] < M|®7" (10) |6 =e. 
(=>) Set e = 1 from the stability proof. Then 
|x(t)| = |@(1)@~! (19) x0 | <1 for t> fo if |xo| < 61, &), 
which implies that 
| (1) @~(to)| < —— 


1 
d(1, to) 
Therefore 


1 
|D(t)| =|®(1)O~! (19) B(1)| < |@(O™! (10) || @(0)| < Fh) Pool = 


This completes the proof of (a). 
Next, we prove (b). We already know that the zero solution is stable. Now 


|x(t)| = |®(t)®7!(t9)x9| > 0 as t > 00 


if and only if 


|@(t)| ~ 0 as tow. 


This completes the proof. 


Theorem 4.2.2. Let ®(t) be the fundamental matrix of (4.2.1). Then the zero solution 
of (4.2.1) is uniformly stable if and only if there exists a positive constant M such that 


|O(r)@-!(s)| <M, t>s>0. (4.2.2) 
Proof. (<=) Let ®(t) be the fundamental matrix of (4.2.1). Then the unique solu- 
tion x of (4.2.1) is given by x(t) = ®(t)@~!(s)x(s). Since (4.2.2) holds for all s 
such that t > s > 0, we have that 

|x(1)| = |@(1)O™!(s)x(s)| < |@()O"(5)||20. 
Thus for any ¢ > 0, choosing 56 = =, we get that for |x| < 4, 
Ix < me oes <Mb=e. 

(=>) Set e = 1 from the proof of uniform stability. Then 


|x(t)| = |@(t)®!(s)x(s)| <1 for r>s if [x(s)| <8(), 
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which implies that 


1 
= _ 


This completes the proof. 
The next theorem provides necessary and sufficient conditions for the UAS. 


Theorem 4.2.3. Let ®(t) be the fundamental matrix of (4.2.1). Then the zero so- 
lution of (4.2.1) is uniformly asymptotically stable if and only if there exist positive 
constants M and B such that 


|@(r)@~!(s)]| < Me PO), t > 50. (4.2.3) 


Proof. (<=) Let ®(t) be the fundamental matrix of (4.2.1). Then the unique solu- 
tion x of (4.2.1) is given by x(t) = ®(t)@—!(s)x(s). It is evident from (4.2.3) that 
the zero solution is US. For all t > s > 0, we have that 


Ix()| =|)" !(s)x(s)| <|@O"()Ilx01. 
1 
As aresult, we may set y = 1. Now we take T (yz) = — gla 0 < pu <M. Then 
for |xo| < 1 andt >t + 7 (uw), we have 
|x(1)| = |®(1)@" | (t9)xo| < Me PO = Me PT <p, 


(=>) Since the zero solution is UAS, there exists y > 0 such that for each yz > 0, there 
exists T = T(z) > O such that |x(to)| < vy, t >to + T, implies |x(t, to, xo)| < u. Let 
a= a Then |xo| < y and t > #9 + T(w) yield 


|®(1)@™" (to)xo] <u. (4.2.4) 
Therefore 
IO(t ++ T(u)) ©! (1)| <a <1, t>0. (4.2.5) 
For t > fo, there is a positive integer k such that 
to +kT (uw) <t<tot+(kK+ DT). 
Now let t) =to+ (K+ 1)T(u),n=1,2,...,k. Then by (4.2.4) and (4.2.5) 


[D(1)O7! (19) = | ONO NH )O(H)O | (H_1)... B(4) 7" (H)| 
k-1 


< lOO! (%)| [] Onde") 
n=0 


< Mok. 
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Let 6 = — Tylana) > 0. Then 


M 
|©(t)b~!(t9)| < —ak*! 
a 


_ M o-atnsTy) 
a 

« M-At-n) 

~ a 

= Le PU-00), 


This completes the proof. 


Example 4.5. The nonlinear system 
O 1\ f/x 
! 1 
vo=(8 ) (Rt). 10. 
em of 


has the fundamental matrix 
2 
t t 
O(t)= ,t>0. 
© ¢ ') 


By Theorem 4.2.1, its zero solution is unstable, since there is no constant M such that 
[||| <M. 


Example 4.6. The system 


xH= >) ) tO; 


has the fundamental matrix 


@(t) =e" ( cos(t) sin(t) 
(t)=e : . ,t>0. 
—(cos(t) + sin(t)) cos(t) — sin(f) 


After some calculations, we can verify that for some positive constant K, 
JOO Ns] < Ke, t>s>0, 


and by Theorem 4.2.3 the zero solution is UAS. 


4.3 Floquet theory 


This section is concerned with homogeneous systems of the form 


x'(t) = A(t)x(), (4.3.1) 
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where the matrix A(t) is periodic with period T (constant), that is, 
A(tt+7T)=A(t) forall te R. 


For the rest of this section, we assume that A(t) is a periodic matrix with period T. 
Our aim is to find an expression for the fundamental matrix in this case. Unlike the 
case of a constant coefficient matrix, the fundamental matrix cannot be expressed as 
@(t) = (¢1,.-.., dn) where the j,i = 1,2,...,n, satisfy 


i (t) = ke", 


and (A;, K;),i =1,2,...n, is eigenpairs for the constant matrix A. To reinforce this 
notion, we offer the following example. 


Example 4.7. Consider the nonlinear system 


Cie eg | (:) ee 


Then the corresponding A(t) matrix is periodic with period T = 27. Moreover, A(t) 


has the eigenpairs 
; 1 0 
(sin(t), (3) ), (2, (‘) ip 


Without thinking and not paying attention to the fact that A is not a constant matrix, 
using the obtained eigenpairs, we form the fundamental matrix 


esin(t) 0 
O(t) = ( ‘ ‘) : 


sin(t) 
It is clear that the first column @ (t) = ( 0 is not a vector solution of the system 


sin(t) O) fe) — (sin(t)esir® , 
( 0 °)( 0 )=( 0 ) adie. 


A(tgi(t) 4, (0). 


Hence we cannot use the eigenpairs to obtain the fundamental matrix for the periodic 
differential system. 


since 


In other words, 


Example 4.7 is a living proof of the need to develop a new approach to find the 
fundamental matrix of systems in the form (4.3.1). To motivate the subject, we con- 
sider the scalar differential equation 


x'(t) =a(t)x(0), (4.3.2) 
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where a: R = R is continuous and periodic with minimal period 7. Then every 
solution #(t) of (4.3.2) has the form 


b(t) = celo ards, (4.3.3) 


Set the constant c = 1, and for a constant 2, we observe that 
t+T 
i a(s)ds =XT, aconstant, 
t 
for all t € R, since a(t + T) = a(t). Using (4.3.3) with c = 1, we have 


des T)= alot a(s)ds = elo a(s)ds ofy*" a(s)ds _ b(tye. (4.3.4) 


The number A in (4.3.4) has a profound effect on the behavior of the solution ¢. Ata 
glance, if @ is periodic with period 7, that is, #(t + T) = $(t), then (4.3.4) implies 
that 


At. 


This holds if and only if A = ae The number 2 is called a characteristic exponent 
for (4.3.2), and e*” is called the corresponding characteristic multiplier. More infor- 
mation about the form of the solutions can be revealed by letting the new function 


pit=one™. 
Then the function p is periodic with period T since 
ptt+T) =o 4+T)e*” = gee” = O(Ne™ = p). 
Thus any solution of (4.3.2) can be written in the form 


b(t) = pte. (4.3.5) 


Eq. (4.3.5) is very significant in the sense that it allows us to study the behavior of all 
solutions on —co < t < +00. As noted above, ¢ is periodic with period T if and only 
ifrA= an Similarly, @(t) — 0 as t > oo and becomes unbounded as t > —oo if 
and only if Rea < 0. 

Now we go back to the periodic system (4.3.1). 


Theorem 4.3.1. Let A(t + T) = A(t) for all t € R. If B(t) is a fundamental matrix 
of (4.3.1), then so is ®(t + T), and there exists a nonsingular constant matrix B such 
that 


(a) (+7) = O(t)B for allt € R; 
(b) det(B) = ol tr(A(s)) ds, 
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Proof. (a) Set Z(t) = ®(t + T). Then 
Z' (th = @'(¢ +T) =AC+T)OG+T) =AMOE+T) = ZHOE+T). 


Moreover, det(Z (t)) — det(® (+ + T)) #0, since @(t) is a fundamental matrix. This 
proves that ®(¢ + T) is also a fundamental matrix. The second part of (a) follows 
from Theorem 3.2.5. This completes the proof of (a). For the proof of (b), we let 
W(t)= det((r)). From Theorem 3.2.3 we have that 


Wi) = Wto)el0 wr(A())ds 


and hence 


t+ 
Wt+T)= Wtoelo™ tr(A(s))ds 


— weal r(A(s))ds+f*7 w(A))as) 


= W(to)e i tr(A(s))ds - on tr(A(s))ds 


=Witelo tr(A(s) as. (4.3.6) 


In addition, 
O¢t+T)=O(t)B 
or 
det(®(t + T)) = det((r))det(B). 
Thus 
Wt+T)= W (t)det(B). (4.3.7) 
A comparison of (4.3.6) and (4.3.7) gives 


det(B) = ole (At))as 


Remark 4.1. Note that since the matrix B is constant, we can uniquely determine it 
by evaluating both sides of (a) at tf = 0: 


B= !(0)@(T). 
We have the following definition of Floquet multipliers. 


Definition 4.3.1. Let ®(t) be the fundamental matrix for the Floquet system (4.3.1). 
Then the eigenvalues (1, 02,..., Pn of 
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B:=07!(0)0(T) 


are called the Floquet multipliers of the Floquet system (4.3.1). 
The Floquet exponents are [11, [l2,..., [Ln Satisfying 


CT Ca ee (4.3.8) 
Note that w;, j =1,2,...,n, may be complex. 


Remark 4.2. (i) If ®(0) = J, then from item (b) of Theorem 4.3.1 it follows that 


n 
det(B) — I] pj= elo tr(A(s))ds_ 


j=l 


(ii) Since the trace is the sum of the eigenvalues, we also have 
n 
tr(B) = > pj. 
j=l 


(iii) The exponential exponents are not unique since if p; = ei’, then p; = 
hj t PT 

(iv) The Floquet multipliers p; are intrinsic parameters of system (4.3.1) and do not 
depend on the choice of the fundamental matrix ®(t). 


Proof (of (iv)). Suppose W(t) is another fundamental matrix. Then by Theo- 
rem 4.3.1, there is a nonsingular matrix B such that 


Wt+T)=WO)B. 

Now by Theorem 3.2.5 
W(t) = B(L)C, 
where C is a nonsingular matrix. Thus 
Wt+T)=O¢4+T)C 

or 

WA)B=(OMB)C. 
This gives 

O(t)CB=O(t)BC, or CB= BC. 

As a consequence, 


CBC!=B, 


so the eigenvalues of B and C are the same. 
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Theorem 4.3.2. Let p be the Floquet multiplier of (4.3.1) with the corresponding 
Floquet exponent «1. Then there exists a solution x(t) of (4.3.1) such that 


(a) x(t+T)=px(t); 
(b) There exists a continuously differentiable periodic n x | vector function p with 
period T such that x(t) = e“ p(t). 


Proof. Let p be an eigenvalue of the matrix B with corresponding eigenvector b. Let 
@(t) be a fundamental matrix of the Floquet system (4.3.1) such that x(t) = ®(t)b. 
Then 
xt¢+T)=®¢+T)b 

= O(t)Bb 

= p@(t)b 

= px(t). 
This proves (a). As for (b), we take p(t) = x(t)e~. Then 


ptt+T)=x(t+T)e hr? 
= px(the HOt?) 
= pe #? x(t)e 
=x(the 
= p(t), 
where we have used p = e“”. This shows that p(t) is periodic with period T. As 


a result, we have that x(t) = e“’ p(t). This completes the proof of (b) and the theo- 
rem. 


Remark 4.3. Suppose a Floquet multiplier p is complex. Since p is an eigenvalue of 
the matrix B, then so is its conjugate o. Then we have two solutions, x and x. Let 
the Floquet exponent jz = ¢ + in, and consider the periodic complex vector p(t) = 
q(t) + ir(t). We may write the corresponding two solutions as 


x(t) =e p(t) and x(t) =e p(t). 
Explicitly, we have 
x(t) =e@F"'(q(t) + ir) 
=e [(a (1) cos(nt) — r(t) sin(nt)) + i(r(@) cos(nt) +.4(t) sin(nt)) 
and 
X(t) = e€-™ @@ — ir@) 
= ‘l(g (1) cos(nt) — r(t) sin(yt)) — i(r(t) cos(nt) + q(t) sin(nr)) | 
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As a consequence, we may write the linearly independent real solutions 


xp =Re[eM p(t)] =e E (t) cos(nt) — r(t) sin(nt)], (4.3.9) 
x7 = Im[eM p(t)] =e [ (t) sin(nt) + r(t) cos(nt) | (4.3.10) 


Lemma 4.1. (Logarithmic matrix) If B is ann x n matrix, then there existsann xn 
(complex) matrix C such that B = e©. 


Proof. Letir.;, 7 =1,2,...,m, with m <n denote the eigenvalues of B. We already 
know that 


eP ICP = piel p, 
Therefore we may assume that P is in Jordan canonical form, that is, 
P Sade (indeiex Ia) 
with 
Jj =i + Nj, Aj £9, 
where J; and N; are defined in Theorem 3.2.12. Suppose that 
B =diag(Bi, Bo,..., Bn), 


where 


Let /; x 1; be the size of Bj = A; 1; + Nj, where N‘i =0 (zero matrix) for all k > m. 
Thus pe 14 =n, and so we have constructed a matrix B of size n x n. Thus if we 
can prove that for every B;, there exists a matrix C; such that Bj = ei, then B=e°. 
Define 


Cj = (Ln(A ;) 1; + Lj, 


where 
m k 
(-Nj) Nj 
Lj:i=- “"_ = TL n(/J; + —). 
j > nj i 


t= 
k=1 kX; 


Recall that at x = 0, 


(ee) 


Lal +x) =) > 


k=1 


(—x)! 
k 


» |x| <1, 
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which implies that 
1 
lee eV S14 Gaz rr B45 aye 4° /2 
1 
ta? Shaw + qe PE /2Fe B+.) +o 


Since N!i = 0 (zero matrix) for all k > m, we must have 
N; 
L; j 
eJ=1;+— 
j iy 

or 
Bj — ela ith; , 


where we have loosely used the fact that B; = e/(4))_ This completes the proof. 


Now we are ready to state and prove the Floquet theorem. 
Theorem 4.3.3. (Floquet theorem) Every fundamental matrix of (4.3.1) has the form 
O(1) = P(e, 
where P(t) is a T-periodic matrix, and C is a constant n x n matrix. 
Proof. Let ®(t) be a fundamental matrix of (4.3.1). Then 
(PNH)&E+T)) = (OND OC+T) +O OC+T) 
=-O'(HNAHOG+T) +O 'MAMOE+T) 
=0. 
Thus 
ono +T)=B (constant matrix), 
or 
O¢+T)=P()B. 


Since @~!(t) and ®(t + T) are nonsingular, B is also nonsingular. Thus by 
Lemma 4.1 B = e©? for some constant matrix C. Left to show that P(t) is periodic 
with period T. We define P(t) = ®(r)e~©'. Then 


PHT) =O(t+T)e CO” 
= &(t)e? eC) 
= O(t)eC! 
= P(t). 


This completes the proof. 
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Example 4.8. Let us find the Floquet multipliers and exponents of 


A 7 é 
~\ 0 1+ cos(t) — Tan ay 


We notice that the corresponding coefficient matrix is periodic with period 277. We 
easily solve 


sh= (14+ cost) — PO) an 


using separation of variables and obtain 
x2 = cre! tS (2 + cos(t)). 


Substituting x2 into x} = —x, + x2 and then using the variation of parameters for- 
mula, we obtain 


xy = coe tO 4 cent, 


Setting cj = cz = 1, we obtain the fundamental matrix 


sis ef tsin() et 
si — : 
et+sin®) (2+ cos(t)) 0 


From Definition 4.3.1, we have 


3 = 0 5 en elm eon 0 
B:=® (0)®(T) =® (0) ®(277) = = . 
1 —-4/\3e" 0 0 e 


Then the eigenvalues of B, o; = e2™ and p2= e72t 


Floquet exponents j41 = 27 and 2 = —27. 


are the Floquet multipliers with 


Example 4.9. Find the Floquet multiplier and exponent of 
x'(t) = (2 —cos(t))x(t). 
Using separation of variables, we find the solution 
x(t) = ket 


for some constant K. Set K = 1. Then the Floquet multiplier is op = x—!(0)x(2Qx) = 
1e4”, and the Floquet exponent is pz = 477. 


One of the main purposes of Floquet theory is to study the stability of the zero 
solution of (4.3.1). It is evident from Theorem 4.3.2 that the behavior of a solution 
depends on the Floquet exponent jz. In fact, from Theorem 4.3.2 we have that 


x(t) =e p(t), 
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where p(t) is a periodic n x 1 vector. Let x; be the jth component of the vector 
solution. Then from Theorem 4.3.2 we have that 


Xj(t) = pjxj) 
and 
xj@t+NT) = pi! x;(t) —>0 as Noo. 
Now we can easily see that each Floquet multiplier falls into one of the following 
categories: 


(a) If || < 1, then Re(yz) < 0 and so x(t) > Oas t > oo; 
(b) If o =+1, then Re(w) = 0, and so the solution is periodic with period T; 
(c) If || > 1, then Re(z) > 0, and so x(t) > oo ast > oo. 


We have the following general theorem concerning the stability of the zero solution 
of (4.3.1). 


Theorem 4.3.4. The zero solution of (4.3.1) is 


(i) stable if and only if the Floquet multipliers p satisfy |p| < 1 and there is a com- 
plete set of eigenvectors for any multiplier of modulus 1; 
(ii) asymptotically stable if and only if |p| < 1 for every p. 


Proof. Let ®(t) be the fundamental matrix of (4.3.1). Then by the Floquet the- 
orem, we have that (rt) = P(t)e“'. Then the solutions of (4.3.1) are given by 
x(t) = P(t)e“' xg, where x9 € IR”. We make two claims: 


(1) the stability of the zero solution of (4.3.1) is the same as for 
y'()=Cy(), (4.3.11) 


which has solutions of the form y(t) = e@'xo. To see this, let M bea positive constant. 
Since P(t) is continuous and periodic, we have that || P(t)|| < M for all t ¢ R. Thus 
|x(t)| = |P(t)e“'xo| < M|le“'xo|| = M|y(t)|, and this completes the proof of the 
first claim. 

(2) y(t) = P-'(t)x(t) is a solution of y(t) = Cy(t). To see this, let y(t) = 
P—!(t)x(t). Then 


y(t) = P|) B&(t)x0 
= P7!(t)P(t)e“ x9 


= exo, 


which is a solution of y’(t) = Cy(t). This completes the proof of the second claim. 


Next, we address the proof of stability. 
If |e| < 1 for all Floquet multipliers, then Re(jz) < 0 for all Floquet exponents, 
and the zero solution is AS for (4.3.11) and hence for (4.3.1). 
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Now we assume that |o| < 1 for all o and there are no generalized eigenvec- 
tors (see (3.2.26)) of e©? corresponding to Floquet multipliers with |p| = 1. Then 
Re(u) < 0 for all eigenvalues of C, and there are no generalized eigenvectors of C 
corresponding to eigenvalues with Re(j) = 0. As a consequence, we have that |e“'| 
is uniformly bounded. Thus the zero solution is stable for (4.3.11) and hence for 
(4.3.1). 

If o > 1 for some p or if there is a generalized eigenvector of e©? with p = 1, then 
either C has an eigenvalue with Re(jz) > 1 or C has a generalized eigenvector with 
Re(jz) = 0. In both cases, | y(t)| > co as t > oo. This implies that the zero solution 
of (4.3.11) is unstable. On the other hand, since P(t) is continuous and periodic, we 
have that P~!(r) is also continuous and periodic. Thus 


y(NT) = P~!(NT)x(NT) x0 
for a positive integer N. Therefore 


oo= lim |y(NT)| <||P7'(NT)|| lim |x(NT)|, 
N00 N>oo 


and the zero solution is also unstable for (4.3.1). This completes the proof. 


We provide the following example. 
Example 4.10. Consider the periodic system with period z 
ce —1+4sin?(t) —1— 4 cos(t) sin(r) (::) . 
1—4cos(t)sin(t) —1+ 5 c0s?(r) x2 


By inspection we found the fundamental matrix to be 


(1) = os sin(t) e ond 


e/2 cos(t) ee? sin(r) 
We encourage the reader to verify that 
®'(t) = A(t) P(t). 
Then 
B:= 7 !(0)&(T) = (0) ®(z) 


_(0 1 0 -e*\ [(-e""? 0 
“Ad O} \_.-x/2 0) 0 ge} 


and thus the eigenvalues of B are given by pj = —e~7/* and p2 = —e~* with 


|pi| < 1,1 =1, 2. By Theorem 4.3.4 the origin (0, 0) is asymptotically stable. 
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4.3.1 Mathieu’s equation 


We begin by considering the 2 x 2 real entries and constant matrix 


D= (: 4) 
Let L(A) = det(D — AJ). Then L(A) can be easily computed to be 
L(A) =? — (a +d) +.ad — bc =? — tr(D)dA + det(D). (4.3.12) 
On the other hand, if A; and 42 are the eigenvalues of D, not necessarily distinct, then 
LA) = (A An)(A = Az) =A? — (Ar FAQ)A + AtAd. (4.3.13) 
A quick comparison of (4.3.12) with (4.3.13) gives 
tr(D) =A, +A2 (4.3.14) 
and 
det(D) = A, A2. (4.3.15) 
Next, we consider Mathieu’s equation 
x"()+ (a +B cos(t)).x(t) =0 (4.3.16) 


with parameters a and f. Eq. (4.3.16) was discovered by Emile Léonard Mathieu, 
who encountered it while studying vibrating elliptical drumheads. It has applications 
in many fields of the physical sciences, such as optics, quantum mechanics, and gen- 
eral relativity. The equation tends to occur in problems involving periodic motion or 
in the analysis of partial differential equations and boundary value problems possess- 
ing elliptic symmetry. Using the transformation x; = x, x2 = x’, we write (4.3.16) in 


the system form 
a 0 1 xX] 
x= (_, — Bcos(t) 4 ) 


It is clear that the system is a Floquet system with a period of 27. Let ®(t) be a fun- 
damental matrix. Then the Floquet multipliers o; and p2 are the eigenvalues of the 
matrix 


B=07!(0)®(T). 


Since tr(A) = 0, where 


0 1 
= (_, — Bcos(t) ‘) : 
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by Theorem 4.3.1, we have that 
ls T 
det(B) = I] p= edo tr(A(s))ds ae 
j=l 
Thus by (4.3.15), 
pip2 = 1. 


As consequence of (4.3.12)—(4.3.15), the eigenvalues or Floquet multipliers must sat- 
isfy the quadratic equation p? — (p; + p2)o + 1 = 0. Letting ¢ := o(a@, B) = p1 + p2, 
we atrive at the characteristic equation 


p?—¢p+1=0. (4.3.17) 


Eq. (4.3.17) has the roots 


1 
P12= 5% + \/¢? —4). 
Despite the fact that we cannot solve for ¢, we can still deduce some information 
about the solutions by considering particular values for 6. Below we consider several 
cases that depend on assigned values of @. 


1. Case 1: @ > 2. 
Since 91,2 = 5(¢ + J¢? —4), we have ~ > 1, and since p1p2 = 1, we have 
pi>1>p2>0. As po = Z we conclude that 42 = —1. Thus according to 


Theorem 4.3.2, the solution must be of the form 
x(t) =cye"" p(t) + cae" po(t), 


where p(t) and p2(t) are both periodic with period 277. Moreover, the zero solu- 
tion is unstable, and solutions are unbounded. 
2. Case 2: 6 =2. 

Then p; = ~2 = 1. In this case, Theorem 4.3.2 guarantees one solution of the 
form e“‘ p(t). On the other hand, if B has two corresponding linearly inde- 
pendent eigenvectors, then we can find two linearly independent 2z7-periodic 
functions p;(t) and p2(t), so that the general solution has the form x(t) = 
cipi(t) + c2p2(t), since p = 1 implies 4 = 0. Now if B has only one eigen- 
vector, then we end up with a solution of the form p(t) and another of the form 


tp\(t) + p2(t). This is due to the fact that the Jordan canonical form of the matrix 
Bis i : , and the solution takes the form 


| 


t Mt Mt uG v 
P(t) = panel? ) = P(t) “) = ea (‘ te . 
e 
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In conclusion, we have a solution of the form 


x(t) = (c1 + cot) pit) + c2pr(t), 


which is unbounded, and, moreover, the zero solution is unstable. 

3. Case 3: 6 = —2. 
Then p; = p2 = —1. This is similar to Case 3. We know that p = e47 = —1, 
which implies that p= am, since 


The solution is given by 


x(t) =(c1 Feat) pi (eT! + copr(teT", 


which is a combination of a periodic solution with period 47 and a nonperiodic 
solution. Again, solutions are unbounded, and the zero solution is unstable. 

4. Case 4: -2 < <2. 
Without loss of generality, we may define n by ¢ = 2cos(nT), where 0 < nT <z, 
so that 


1 
p= (e+ ¢? —4) 


=cos(nT) +i sin(nT) 


= etinT 


Since ¢ = 0, Eqs. (4.3.9) and (4.3.10) reduce to 


xp =Re[e’ p(t)] = q(t) cos(nt) — r(t) sin(nt), 
x1 =Im[e'™ p(t)|] = ¢() sin(nt) + r(t) cos(nt), 


where p(t) = q(t) +i r(t) is periodic with period 27. With this in mind, the 
solution takes the form 


x(H=c (a@ cos(nt) — r(t) sin(1)) ges (4 (t) sin(nt) + r(t) cos(1)). 


We easily see that the zero solution is stable and solutions are bounded, but it 
is not periodic in general as there are two frequencies 27 and 7. In such a case, 
the solution is said to be pseudoperiodic. Next, we examine the period of 7. Now 


e!! has the period T:= = Since 0 < 2cos(nT) < 2, or, 6 4 £2, we must have 


ae 2nT Bet eee ZIe. a9 i ay 
nT A ju, j=1,2,..., 06 7 # jm, which implies that — 4 T. This gives 
J 


: 3 
T #27,T, 37... 
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Note that in order that 7 = nT, we must have 


_ 20 


oe 


forn £1, 2. 


4.3.2 Applications to Mathieu’s equation 
4.3.2.1 Inverted pendulum 


An application of Mathieu’s equation is the inverted pendulum depicted in Fig. 4.3. 
We assume that the pendulum is frictionless and has a massless rod of length /. If 
Fpivot 18 the force acting on the pivot, Tpet is the net force to external torque, and J is 
the moment of inertia, then by Newton’s second law, we have 


d*y 
Et =a = a: (4.3.18) 
r, _ 748 _ pao (4.3.19) 
gp eee a 


If F is the force acting on the particle and Tt is the torque, then 


t=rFsin(@), 
where r is the distance from the axis of rotation to the particle. So the gravitational 
torque is 
Terav =I Foray sin(@) = mgl sin(@). 
A 
l 
6 
@ 

FIGURE 4.3 


Inverted pendulum plotted in xy-coordinates. 
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Since the harmonic motion of the pendulum can be expressed as y(t) = Acos(@t), 
Eq. (4.3.18) becomes 


Foivot = ma = mao A cos(wt). 
Now the torque exerted by the pivot, Tpivot 1S given by 
Tpivot = Fpivot Sin(@) = —ml@* A cos(wt) sin(@). 


Thus the total torque thet = Tgrav + Tpivot- AS a result, expression (4.3.19) yields the 
expression 


240 : 2 : 
ml ee = mel sin(@) — mlw* A cos(@t) sin(@) 
or 
a’ 2A 
<a + (= — = cos(t)) sin(@), 


setting sin(@) © 6 for small oscillations, the above expression reduces to 


6" + (a + Bcos(t)) =0 


A 
-—{> and period T = 27. 


® 
II 


4.4 Exercises 


Exercise 4.1. Discuss the flow of solutions around the equilibrium solutions as we 
did in Fig. 4.1 for the following systems: 


(a) 

x'(t) = (1 —x7)xe*, x(0) =x0 £0: 
(b) 

x(t) =x3 +7 +6x, x(0) =2x0 £0. 
Exercise 4.2. Discuss the stability as we did in Example 4.2 for the following IVPs: 
(a) 

(t?7 +9)x'(t) + tx =0, x(0) = x0 £0; 
(b) 


(1+14)x’(t) = —x, x(to.) =x0, t>to>—1. 
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Exercise 4.3. Show that the zero solution of 
x'(t)=—x°, x(t) =x0 #0, 

is UAS. 
Exercise 4.4. The solution of 

x'(t) =a(t)x(t), x(t.) = x0 £0, >t > 0, (4.4.1) 
is given by 

x(t) = get oe 

where a(t) is continuous for t > 0. Show that the zero solution of (4.4.1) is 


(a) stable if and only if there exists a positive constant M such that 
t 
el ce M, t=0; 


(b) asymptotically stable if and only if 
t 
i a(s)ds > —o as t> ow; 
0 


(c) uniformly stable if and only if there exists a positive constant M such that 
ty 
a(s)ds < M foralO <t) <p <a; 


t 
(d) uniformly asymptotically stable if and only if there exist positive constants M 
t 


and @ such tnat f a(s)ds < —a(t —to) + M. 


i) 
Exercise 4.5. Find the fundamental matrix and study the stability of the zero solution 
of the given system for t > 0: 


(a) 
(b) 


Exercise 4.6. Find the Floquet multipliers and exponents of 
s(t)+sin(t) 
x'(th= Taint) —costy 0) (x1 
1 1/ \%2 
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Exercise 4.7. Find the Floquet multipliers and exponents of 


s(t) 
eC) = 1+ ra 0 xq 
1 —1) \2 


Exercise 4.8. Find the Floquet multipliers and exponents of 


(a) 
x'(t) = cos(3t)x(t); 
(b) 
xO= (sins) es cos(3r)) x(t); 
(c) 


¥O= (-1 + cos(2r)).x(0). 
Exercise 4.9. Prove that Bj = e!(8}) in the proof of Lemma 4.1. 


Exercise 4.10. Carry out a similar discussion as in Section 4.3.1 for the second-order 
Hill equation 


x"(t) +a(t)x(t) =0, 
where the function a is continuous and periodic with period T. 


Exercise 4.11. Find the logarithm of the rotation matrix 


= cos(t) —sin(t) 
7 sin(t) cos(t) }” 
Exercise 4.12. Show that all solutions of (4.2.1) are bounded if and only if its zero 
solution is stable. 
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CHAPTER 


Qualitative analysis of 
linear systems 


This chapter is exclusively devoted to the study of the stability of linear systems, 
near-linear systems, perturbed systems, and autonomous systems in the plane. 


5.1 Preliminary theorems 


In Section 4.2 of Chapter 4, we discussed the stability, uniform stability, asymptotic 
stability, and uniform asymptotic stability of the zero solution of the non-autonomous 
linear system 


x’ = A(t)x 
by imposing conditions on its fundamental and principal matrices. In this section, we 


give explicit criteria that satisfy the conditions that were imposed only for the linear 
system with constant coefficients 


x! = Ax, (5.1.1) 


where A is ann Xn matrix with constant entries. We begin with the following lemma. 
Lemma 5.1. Let 

r(t)=t"e “, t>0, 
where m is a non-negative integer, and a is a positive constant. Then there exists 
a positive constant D depending on m and a such that r(t) < D. 


Proof. If m = 0 then r(t) < 1 := D. On the other hand, if m > 0, then by repeated 
application of L’H6pital’s rule we have jim te *' = (0. Moreover, since r(0) = 0, 
00 


r(t) is continuous, and r(t) > 0, we have that r(t) < D for some positive constant D. 
This completes the proof. 


Definition 5.1.1. Let A be a square matrix. We define the spectrum of A as 
o (A) = {A:: det(A — AI) = O}. 
Thus the inequality 
Re(o (A)) <¢ 
for some real number ¢ means that all the eigenvalues of A have real parts less than ¢. 


Advanced Differential Equations. https://doi.org/10.1016/B978-0-32-399280-0.00011-5 1 29 
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The next theorem is concerned with eigenvalues of multiplicity m. 


Theorem 5.1.1. Let 4 be an eigenvalue of a matrix A with Re(o (A)) < ¢. Then for 
any integer m > 0, there exists a positive constant D such that 


tre < De for all t > 0. 


Proof. Let 7 =a + if with a,B € R. If 6 =0, that is, A is real, then since 
Re(o(A)) < ¢, we have that a — ¢ <0. So by Lemma 5.1 


pM e(@—2)t < D forall t > 0. 
Multiplying this inequality by e°’, we obtain 
re = 1" < De® for all > 0. 
Now if 6 4 0, that is, A is complex, then 


[ee | = [rel tiP)t| — pe! < Deb! for all t > 0, 


since a = Re(o (A)) < ¢. This completes the proof. 


Theorem 5.1.2. Let i be an eigenvalue of a matrix A with Re(o (A)) < ¢. Then for 
some positive constant D, any solution x of (5.1.1) satisfies 


|x(t)| < Des" forall t > 0. 


Proof. Let A1,A2,...,A% be eigenvalues of A. We can form a set of fundamental 
solution, x,,%2,...,X, and find an integer N > 0 such that each solution is of the 
form x; = tern! N =1,2,...,k, for integer m. Then by Theorem 5.1.1, we have 


that |x;(4)| < Vier! for positive constants V;. If x is an arbitrary solution of (5.1.1), 
then it can be written in the form 


X(t) = cy x1 (t) + cox2(t) +... + CnXn(t). 
Then for t > 0, 


Ix(t)| < lei lx (t)| + leallx2@)| +... + lenl lan @| 
<|e1|Vied! + |c2|Voeo +... + len| Vanes 


= (IeilVi + lerlV2 +... + lenlVn)e®. 


This completes the proof. 


The next theorem plays an important role in the study of stability, and its proof 
depends on the Putzer algorithm, Theorem 3.2.14. 
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Theorem 5.1.3. Let 4;, i =1,2,...,k, be the distinct eigenvalues of A, where i; 
has multiplicity nj, and nj +n2+...+ng =n. If Re(o(A)) < ¢, then there is a 
positive constant D such that 


et < De?! forall t= 0. 
Proof. From Theorem 3.2.14 we know that 


n—-1 


eM =P a @P;, (5.1.2) 
j=0 
where /11(f), 42(f),..., en(t) satisfy the corresponding initial value problems 


wy =Aie, MO) =1; wy =Azuy + uj-1@), 470) =0, j =2,3,...,n, 


and the matrices Po, P},..., P, are given by 


ji 
Po=l, P;=| [(A-4jD, (21,0 ait: 
k=1 


Then we may easily verify that 


t 
nse. gu@oae” [ e+" w 5(s)ds 


for j =1,2,...,n — 1. Without loss of generality, we may choose the order in {A ;} 
so that the real parts do not decrease, that is, if A; = 0; + ioj;, then p; < pj+1. We 
claim that 
ti-! 
Iu“j()| < e?i' fort >0, j=1,2,...,n. (5.1.3) 
(j=)! 


Obviously, (5.1.3) holds for j = 1, since 41 (t) = e*!’. Thus let it hold for j. Now 
from the above integral defining 4 ;+1(t) we have 


j-l 


G—D! 


t 
nine) = erin" f e Pits ei ds, 
0 


Since ei—P i+) < 1, the above integral reduces to 


ae 0 Pace Hw 
pyar) =r —— f sg] dsm ee 


By our setup, we have p” is the largest of the real parts, and hence 


a 
bj+i(t) < eh". 
F J! 
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For any exponent j and any p* > 0, we have 
ti <he?! 
for all t > 0 and some positive constant h. Thus 
jgit) shel +P ¢>0, (5.1.4) 
Now substitute (5.1.3) into (5.1.2) and then take the matrix norm to get 


n—1 n—1 
eA < So [mj @UlPall < [ADS | Pylijes = De®. G15) 
j=0 j=0 


This completes the proof. 


As a direct consequence of Theorem 5.1.3, we have the following lemma. 


Lemma 5.2. Suppose all the eigenvalues of A have negative real parts. Then there 
are positive constants h, K, and p such that 


Hj+i(t) < he?! and |\\e"|| < Ke", t>0. (5.1.6) 


Theorem 5.1.4. (i) Assume that every eigenvalue of the matrix A has a nonpos- 
itive real part and that the eigenvalues with zero real parts are simple. Then 
there is a positive constant D such that 


le“"|| < D, r>0. 


Moreover, if x is a solution of (5.1.1), then it is bounded, and the zero solution 
is stable. 

(ii) If Re(a(A)) <0, then the zero solution is AS. 

(iii) [f there is an eigenvalue of A with positive real part, then the zero solution is 
unstable. 


Proof. If 4 =if is a simple pure imaginary, then it contributes a bounded function 
of the form e‘*’ to a fundamental set of solutions. Thus we get a fundamental set of 
solutions with all elements bounded on [0, 00). Since e4’ is formed from such a set, 
an argument similar to the proof of Theorem 5.1.3 shows that 


lle“"|| < D 
for some positive constant D. Now if x is a solution of (5.1.1) with x(t) = xo, then 


x(t) = eA) 


xo for t > to. 
Let ¢ > O and set 6 = ¢/D. Then for |xo| < 6, we have 


[x(t)| = lle“ || |xo| < Db =e. 
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This proves that the solution is bounded, and the zero solution is stable. The proof of 
(i) is complete. 

As for (ii), the zero solution is stable by (i) since Re(a(A)) < 0. Thus we may 
choose a real number ¢ < 0 such Re(o(A)) < ¢. By Theorem 5.1.3 there is a positive 
constant D such that ||e4"|| < De®! for all tf > 0. Hence, for any initial condition 
x(0) = xo, the solution x of (5.1.1) satisfies 


|x(t, 0, xo)| = le4’xo| < D|xoleo’ > 0ast > oo. 


This completes the proof of (ii). 


Remark 5.1. Consider two matrices 


It is clear that each matrix has an eigenvalue 0 with multiplicity 2 (not simple). The 
zero solution of the corresponding system x’ = Ax is stable, whereas the zero solution 
of x’ = Bx is unstable. Therefore careful examination of the stability is required when 
dealing with eigenvalues with zero real parts of multiplicity higher than one. 


Theorem 5.1.5. /f all the eigenvalues of A are distinct with Re(o (A)) < —¢, where 
¢ > 0, then the zero solution of (5.1.1) is UAS. 


Proof. By Lemma 5.2, we have that 
eA < Ke", 120, 
and hence 
eA || < Ke FO), t> 5 >0. 
Now if x is a solution of (5.1.1) with x(s) = xo, then 


Al—S) x9 for t>s, 


x(t)=e 
and the results follow from Theorem 4.2.3, since 


eAl—-5) = @(t)o—!(s), 


This completes the proof. 


5.2 Near-constant systems 


In this section, we examine when solutions of a linear non-autonomous system be- 
have like solutions of an autonomous linear system near zero. We have already seen 
that the stability of zero solution of the system 


x/(t) = A(t)x(t) 
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does not depend on the sign of the eigenvalues of the matrix A(t). For example, the 
system 


Gee —1+ 3cos?(r) 1 — 3 cos(f) sin(r) ah Bay 


—1—cos(t)sin¢) —1+ 3sin°(r) 


has the eigenvalues 


A= 


-Il+ iJ7 
4 
and the principal matrix 
wi) = é'/2 cos(t) — e~* sin(t) 
—e'/2 sin(t) e7! cos(t) 


This tells us that solutions are unbounded and the zero solution is unstable. Thus the 
question that we wish to examine is that if, in some sense, the matrix A(t) is close to 
a constant matrix A, then how closely do solutions of the non-autonomous system 


x'(t) = A(t)x(t) (5.2.2) 
behave like solutions of the autonomous system 
x'(t) = Ax(t)? (5.2.3) 


We assume that both matrices are n x n and A(t) has continuous entries on some 
interval that includes the initial time fo. 


Theorem 5.2.1. Assume that every eigenvalue of the matrix A has a nonpositive real 
part and that the eigenvalues with zero real parts are simple. If 


/ ||A(t)— Alldt< E (5.2.4) 
0 


for some positive constant E, then solutions of (5.2.2) are bounded, and its zero 
solution is uniformly stable. 


Proof. By Theorem 5.1.4 there is a positive constant D such that 
ett <D. 
Rewrite (5.2.2) as 
x'(t) = Ax(t) + (A(t) - A) x(t) (5.2.5) 
and set g(t) = (A(t) _ A)x(t). If x is a solution of (5.2.2) with x(to) = xo, then it 


satisfies (5.2.5), and by the variation of parameters formula (3.3.6) we have that 


t 
x()= Mx + f eA) (A(s) — A) x(s)ds. (5.2.6) 


i) 
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Taking the appropriate norms of both sides of (5.2.6) and estimating give, for 
t>t20, 


t 
Ix(t)| = |leA“— || xo | +f eA" |] [A(s) — All |x(s)lds 
i) 


t 
< Dlx +f DIIA(s) — All [x(s)|ds 
10 


D||A(s)—Al| ds 


< Dixolel (by Gronwall’s inequality) (5.2.7) 


< D\xole?*. (5.2.8) 


It follows that solutions are bounded and the zero solution is uniformly stable by 


choosing 6 = D.DE for any ¢ > O with |xo| <6. 


Theorem 5.2.2. Assume that all the eigenvalues of the matrix A of system (5.2.3) are 
distinct with negative real parts and there is a positive number (to be identified later 
in the proof) @ such that 


||A(t) — Al| <@ (5.2.9) 
for all t > to => 0. Then the zero solution of (5.2.2) is uniformly asymptotically stable. 


Proof. Since Re(a(A)) <0, we may choose a real number ¢ > 0 such Re(a(A)) < 
—¢. By Lemma 5.2, there is a positive constant K such that ||e4’|| < Ke7* for all 
t > 0. If x is a solution of (5.2.2) with x(t) = xo, then it satisfies (5.2.5), and by the 
variation of parameters formula (3.3.6), we have that 


t 
eS er tao / eAl—5)(A(s) — A) x(s)ds. 


i) 


Let 
0<0< a (5.2.10) 
K 


Taking the appropriate norms of both sides gives, for t > 0, 
t 
Ix@)| = le“ II Lxol + i Ile“ || || A(s) — Al] [x(s)|ds 
i) 
t 
< Ke $0) xo] +f Ke7*"—) 6 |x(s)|ds 


to 


or 


t 
inlet = Khsol + f Keb 8-0) 9 |x(s)|ds. 
1 
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Let z(t) = e& “—|x()|. Then the above inequality reduces to 
t 
z(t) < K|xo| +Ko [ z(s)ds. 
i) 
An application of Gronwall’s inequality leads to 
z(t) < k|xp|e*°"—) for all t > to > 0, 
and, consequently, 


x(t)| < klxqle®8- ©) for all t > to > 0, 


from which we arrive at the uniform stability and uniform asymptotic stability of the 
zero solution by imitating the proof of Theorem 4.2.3. This completes the proof. 


Remark 5.2. There is no standard way for forming (5.2.5). It depends on what we 
want from the eigenvalues of A and conditions (5.2.4) and (5.2.9). 


Example 5.1. We show that the zero solution of the non-autonomous system 


x(t) = 2a (5.2.11) 
2+ 3+ 


1 
16(1+1)2 
is uniformly asymptotically stable. We write the system in the form 
e! te! 


} 1 3) ~ 6 1 
ro=(% Alf ees || 
2+ 34°55 


1 
16(1+1y2 


= Ax + (A(t) — A)x. 


Now the eigenvalues of A are —2 and —1. We easily verify that 


—(t—t) —3(t—19) 
e e 
erm = ( ,t2%>0, 


—e lo) _3g—(t—10) 
and 
(erro, ede Fw Fs > 0, 
Moreover, 
AO —Alloo =max{a + >, = + y= 4 for allt >t >0, 
3 6e 16 16 8 


and condition (5.2.10) is satisfied with K = 4, ¢ = 1, and 6 = 2. Thus by Theo- 
rem 5.2.2 the zero solution of (5.2.11) is uniformly asymptotically stable. 
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5.3 Perturbed linear systems 


Suppose we know about the stability of the zero solution of the linear system 
x(t) = A(x(t), t= 0. (5.3.1) 


The question is, what can we say about the stability of the zero solution of the per- 
turbed linear system 


x’ (t) = A(t)x(t) + B(t)x(t), t= 0, (5.3.2) 


where A and B aren x n continuous matrices on the interval [0, co)? In other words, 
under what conditions on B(f) is the perturbed system (5.3.2) stable? It turns out that 
if, in some sense, the norm of the matrix B is small, then a type of stability of (5.3.2) 
can be deduced. Note that in (5.3.2), B(t) is known as the perturbation term. 


Theorem 5.3.1. Assume that the zero solution of (5.3.1) is uniformly sable and that 


/ |B@)||dt < E (5.3.3) 
0 


for some positive constant E. Then the zero solution of (5.3.2) is uniformly stable. 


Proof. Let ®(t) be the fundamental matrix of (5.3.1). Due to the US of the zero 
solution, for some positive constant K, we have 


| (1)! (s)|| < K. 


By the variation of parameters formula (3.3.4), we have that 


t 
x(t) = eo") + f &(t)~!(s)B(s)ds 


i) 


or 
t 
|x(0)| = |]© (2) 7 (to) || Lxo| +f lO) O~"(s)|] [|B(s)|| le (s) ds 
to 


t 
< K|xo| + K||B(s)|| |x(s)|ds 
to 
t 
< K|xolefe Bll as 


< K|xole*®, (5.3.4) 


(by Gronwall’s inequality) 


which implies the uniform stability. This completes the proof. 


The next example shows that the integrability condition (5.3.3) for || B(t)|| is nec- 
essary. 
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Example 5.2. Letting 
i. 
Xx, = X2, 
the second-order differential equation 
x" +x=0 
can be written in the matrix form 


ro=(2 (2) 


with 


Thus its zero solution is uniformly stable. On the other hand, Theorem 5.3.1 says 
nothing about the perturbed system 


2 
x" — <x" +x =0, t > 0, 


; 0 1 0 0 
ro=(2, o) + a 2 x. 


00 2. 
Here B(t) = ¢ >) is the perturbed matrix in the sense that | B(t)| = ; — 0 as 


t — o. Moreover, 
[o.@) [o.@) 2 
i Beolide = [ -dt =o 
r® t* t 


for any t* > 0, and hence B(t) does not satisfy condition (5.3.3). 
Note that the perturbed system has two linearly independent solutions 


xX] sin(t) — t cos(t) Dal cos(t) + f sin(t) 

x2) t sin(t) a t cos(t) , 
and consequently its solutions are unbounded, and as a result, its zero solution is 
unstable. 


which is equivalent to 


Theorem 5.3.2. Assume that the zero solution of (5.3.1) is uniformly asymptotically 
stable, that is, if ®(t) is the fundamental matrix of (5.3.1), then by (4.2.3) there are 
positive constants K and & such that 


I|O(t)b~!(s)|| < KC), t>5>0. 
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Suppose 


[wo sre-w +8, t>to>0, (5.3.5) 
0 


for positive constants y and B. Then the zero solution of (5.3.2) is uniformly asymp- 
totically stable, provided that 


yee 
a 


Proof. Imitate the proof of Theorem 5.3.1 and get 
t 
Ix(le— < Kl xo] + / Ke || B(s)|| |x(s)|ds. 
i) 


Using Gronwall’s inequality along with condition (5.3.5), we arrive at 
g 
In| s Ke*? |xpleh C0), (5.3.6) 


The rest of the proof follows along the lines of Theorem 5.2.2 using inequality (5.3.6). 
This completes the proof. 


5.4 Autonomous systems in the plane 


In most applications, the corresponding modeling systems can be written as two- 
dimensional autonomous systems in the form 


x =P, yy), ¥ =OG9), (5.4.1) 


where P and Q are continuous on some subset of R. Recall that the system is called 
autonomous if P and Q do not depend explicitly on t. System (5.4.1) can be written 
in the form z’ = f(z), where 


x P(z) 
= and f(z) = ( ) . 
(") TO=\ o@) 
Thus the second-order differential equation 
x= g(x, x’) 
can be written in the form (5.4.1) as the system 
/ tf 
x =y, y =g(x,y). 


We begin with the following lemma. We denote the solution of (5.4.1) by the pair 
(x(t), y(t), t € (a,b). 
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Lemma 5.3. Let (x(t), y(t)) be a solution of (5.4.1). Then for any constant k, the 
pair (x(t +k), yt +k)) is also a solution of (5.4.1). 


Proof. Let x1 = x(t +k) and x2 = y(t +k). Then by the chain rule we have 


xy =x (t +k) = P(x(t +k), ye +k) = P(x, x2), 
x= V(t+k) = Oat +k), ye +k) = Or, x2), 


which imply that the pair (x1 (f), x2(t)) is a solution of (5.4.1) fort € (a—k,b—k). 
This completes the proof. 


The results of Lemma 5.3 do not hold for non-autonomous systems. To see this, 
we consider the system 


x’=ty, y=y. 
It readily follows that 
x(t)=(t— De’, y(n =e 


is a solution of the system. However, for any nonzero constant k, we have x(t +k) = 
(t+k—Delt* andx'(t +k) =(t+het* ¢ty(t). 


Definition 5.4.1. The solution (x(t), y(t)) of (5.4.1) as t varies describes parametri- 
cally a curve in the plane, which we call a trajectory (or orbit). 


Theorem 5.4.1. Different trajectories of (5.4.1) cannot intersect. 


Proof. Let C, and C2 be two trajectories represented by (x1 (t), yi (t)) and (x2(f), 
y2(t)), respectively, with a common point (xo, yo). Then there are two different times 
(otherwise, uniqueness is violated), say t; and tz, such that 


(xo, Yo) = («1 (41), yi (41) = (x2 (22), yo (t2)). 
By Lemma 5.3 
xQ)=x1t+h —t2), \O=yit +h — t2) 


is a solution. Since (x(t2), y(t2)) = (Xo, yo), we have that x(t) and y(t) must agree re- 
spectively with x2(t) and y2(t) due to the uniqueness. Thus C; and C2 must coincide. 
This completes the proof. 


Remark 5.3. Be aware that a trajectory is a curve represented parametrically by one 
or more solutions. Thus x(t), y(t) and x(t +k), y(t +k) for k £0 represent distinct 
solutions but the same trajectory. 


Example 5.3. The damped harmonic motion represented by the second-order differ- 
ential equation 


u’ +2u' +2u=0 
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can be easily transformed into the planar autonomous system 


x =Yy), 


y’ = —2x —2y. 


The eigenvalues of the system are found to be A = —1 +7. Hence the solution is 


x =e ‘(cy cos(t) +c sin(t)), 
y= e ' (—c sin(t) + c2 cos(t)). 
To describe the trajectories, we find that 
x+y s(t tee, 
which describes a family of spirals. 
We begin a detailed study of the linear plane autonomous system 


KAN (5.4.2) 


where 


is a nonsingular matrix, and 


The characteristic equation for this system is 
 —(a+d)rA+ad —bc=0. 
By introducing 


p=a-d, 
gq =ad — be, 


the characteristic equation becomes 
7 — pA+q=0. 


Let A; and A> be the roots of this equation, 


1 
3 = 5 E +,/ p> — 44] : (5.4.3) 
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It is obvious that the signs of A; .2 and hence the stability of the zero solution depend 
on the discriminant 


A= p’ —4q = (tr(A))* — 4det(A). 


Based on Theorem 5.1.4, we can now state the following stability theorem of the 
zero solution of (5.4.2). 


Theorem 5.4.2. The zero solution of (5.4.2) is 


a) asymptotically stable if any of the followings occurs: 


i) 
A>0,q>0, and p <0, 
ii) 
A=0, p <0, 
iii) 
A <0, p <0; 
b) stable if 
A <0, p=0; 
c) unstable if any of the followings occurs: 
i) 
A>0,q>0, and p> 0, 
ii) 
A=0, p> 0, 
iii) 
A <0, p>0. 


Remark 5.4. In the case where p = 0 and g = 0, further analysis is required to deter- 
mine the stability of the zero solution. 


Note that according to Theorem 5.4.2, the zero solution (0,0) of the system in 
Example 5.3 is asymptotically stable. 


Next, we consider the behavior of the trajectories of system (5.4.2) for various 
cases of the eigenvalues. In what follows, we use the matrix transformation 


Y = BX, det(B) £0, 


so that the essential behavior near the critical point (0, 0) remains unchanged. 
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1. Real and distinct roots. If we let 
c hkj-a 
B= (: Ao - ‘) ‘ 
then system (5.4.2) transforms into the system 


x’ =A\x, 


y =Agy, 


where, for simplicity, x and y are again used as the new coordinates. For some arbi- 
trary constants c; and c2, the solutions of the system are 


x(t) = ce", y(t) = ce". (5.4.4) 
Eliminating the time ¢ in (5.4.4) gives 
42 
y=ex', (5.4.5) 


where c is an arbitrary constant. When A, and 2 have the same sign, then Eq. (5.4.5) 
represent parabolic curves that are tangent to the origin as shown in Fig. 5.1(a). The 
origin is called a proper node. We have the following three subcases. 

1.(a) If both A1, A2 are negative, then the origin is asymptotically stable. In this case, 
we have a stable node. 

1.(b) If A1, Az are positive, then the origin is unstable. In this case, we have an unsta- 
ble node. 

1.(c) If Ay, Az have opposite signs, then (5.4.5) represents hyperbolic curves as shown 
in Fig. 5.1(b). The origin is unstable and is called a saddle point. 


2. Real and equal roots. In this case, A = (a — d)* + 4bc = 0, which implies that 


(a+d) 


Ap =A. = 5 


‘— 1); 


2. (a) If b or c= 0 and a = d, then system (5.4.2) reduces to 


As before, solving the system and eliminating ¢ lead to the trajectories that are lines 
through the origin given by 
c2 
= * 
cl 


Thus, if A < 0, then the origin is asymptotically stable and is a proper node, as shown 
in Fig. 5.1(c). If A > 0, then the origin is unstable. 


Copyright Elsevier 2022 


ER 


144 CHAPTER 5 Qualitative analysis of linear systems 


(b) This is a more complicated case. If we let 


then system (5.4.2) transforms into the system 


/ 
x =dx, 


yl’ =x+Ay. 
For some arbitrary constants c; and c2, the solutions of the system are 
x(t)=cye", y(t)=(cit tere. (5.4.6) 


The trajectories are shown in Fig. 5.1(d), and the origin is an improper node; it is 
asymptotically stable when A < 0 and unstable when A > 0. 


3. Complex roots. In this case, we let 
A; =a+if and 42 =a — if 


and choose the matrix 


so that system (5.4.2) transforms into 


x’ =ax — By, 


y' = Bx+ay. 
3. (a) For a = 0, this system becomes 


r= —By, 
y’ = Bx, 
with solutions 
x(t) =c;cos(Pt) + cz sin(6t), y(t) =c, sin(Bt) + c2 cos(Br) 


for arbitrary constants c; and cp. It is easy to verify that the trajectories are circles 
given by 


2 2 2 2 
Xx +y =ci +c9 


and are shown in Fig. 5.1(e). In this case the origin is stable but not asymptotically 
stable. 
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3. (b) For a 4 0, the above system has the solutions 
x(t) =e" (cy cos(Br) + c2 sin(Bt)), y(t) = e* (c1 sin(Bt) + cz cos(Br)) 


for arbitrary constants c; and c2. The trajectories are spirals given by 


ery =(cF4+ 50" 


and are shown in Fig. 5.1(f). In this case the origin is a focal point, which is asymp- 
totically stable when a < 0 and unstable when a > 0. 

The solutions of a planar system of linear differential equations can be classified 
according to the trace and the determinant of the coefficient matrix. This diagram 
schematically shows the different types of solutions. 


Poincaré Diagram: Classification of Phase Portraits in the (detA, TrA)-plane 


<7 


spiral source 


(© 


center 


A=0: detA=} (TrA)? 


| 


spiral 


degenerate source 


degenerate sink 


uniform 


TrA 


line of stable fixed points saddle line of unstable fixed points 


5.5 Hamiltonian and gradient systems 


Consider the pendulum with friction discussed in Example 3.5: 
/ 
X, = X2, 
g . b 
5 = —2 sin(x1) — —x2. 
Xo L (x1) a X2 
Define the energy function H : [to,@) x R* > [0, 00) by 


1 
H(x1,.22) = 5230) + z(1 — cos(x1(1))). 
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FIGURE 5.1 
A phase portrait gallery. 
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Then along the solutions of (3.2.7) we have that 


d meee ee ae ' 
Fe te) = ag a) 


dt 
b 
= n(-2 sin(x1) — — x2) + F sin(x1)x2 
b 2 
=> yee 


If the friction b > 0, then LH (t) < 0, and the energy is dissipated. On the other 
hand, if b = 0, then the energy is conserved, and theoretically, this solution lies on a 
level curve 


A (x(t), x2(t)) = constant := c 
of the function H(x,, x2) with variables x; and x2. Thus, in the case b > 0, this 
solution will not stay on a level curve. Hence centers are possible for (3.2.5). 


When the energy is conserved, we obtain an example of a Hamiltonian system. In 
our situation the system 


%) 94; 
(5.5.1) 
x, = —F sin(x1) 
can be written in the form 

‘ 0H 

t= = 
: : 0x2 

j g. 0H 
=-——sin =-—. 
Xo t (x1) fay 


Since the Hamiltonian function conserves the energy, it is constant along solutions. 
The level curves are given by 


 2(t) = - cos(x1(t)) =e. 


2 
System (5.5.1) has the equilibrium solutions (+n7, 0),n =0,1,.... It will be shown 
in Chapter 6, when there is no damping or friction, that is, b = 0, then (nz, 0) are 
centers for n = 2,4,6,... and unstable saddles for n = 1,3,5,.... Phase portraits 


and level curves are shown in Fig. 5.2 for different values of c. 
Thus we have the following definition. 


Definition 5.5.1. A planar system of differential equations is called a Hamiltonian 
system if there exists a differentiable function H (x1, x2): IR? — R such that 


dH 
x, (¢) = Dixy? 5 5 2) 
l(\ — 0H mt 
X(t) = — 35, - 


Such a function H (x1, x2) is called a Hamiltonian function of system (5.5.2). 
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Re. 4RK?K 


Phase portraits and level curves for (5.5.1) for different values of c. 


Ss 


ye 


Consider the second-order differential equation of the form 
x" — f(x)x' — g(x) =0 
In system form, we have 
/ 
x) = 2, 
x) = g(x) + f (x1) x2. 
Let 
1, ad 
Hsia) = 5x30 + (- [© e0oras), 
0 


x(t) 


where 5 (x’ )* corresponds to the kinetic energy, and — dG g(s)ds represents the 


poenial energy. Then it is easy to verify that 


; dH 
Xy aS XO is 
I . 0x2 


0 
x)= a(x) + fia =- , 
Ox] 
only if f(x) =0. We conclude that the Newtonian system 


x =e) 


with g continuously differentiable on R is a Hamiltonian system. 
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For the Hamiltonian system (5.5.2), the energy is always conserved. To see this, 
let (x1 (t), x2(f)) be any solution of (5.5.2). Then 


Le CN ORT ON eee meee) 
dt Ox] 0x2 
_ 0H aH aH ( aH am as 
0x, 0x2 0x2 OX] 


That is why a Hamiltonian function is sometimes called an energy function. In appli- 
cations, the Hamiltonian function is defined by 


H(x,y)=K(x,y)+ VG, y), 


where K is the kinetic energy, and V is the potential energy. 
Next, we establish conditions for the planar system 


1 =fO.9). ¥ =8659) (5.5.4) 


to be a Hamiltonian system. If (5.5.4) is a Hamiltonian system, then there is a function 
Ai satisfying 
H 0H 
3. =F, y) and ——— = g(x, y). 
oy Ox 
Assuming that the function H has continuous second-order partial derivatives, we 
arrive at 
of 0H <0°H ag 
dx Oxdy dydx dy’ 
Thus we have shown that condition (5.5.5) is a sufficient condition for system (5.5.4) 


to be a Hamiltonian system. 
The system 


(5.5.5) 


x! =x+ y 
y! =-y- x2 
is Hamiltonian since of =l= a =—(-1). 
The next theorem provides necessary and sufficient conditions for the existence 
of Hamiltonian function. 


Theorem 5.5.1. The planar system (5.5.4) is a Hamiltonian system if and only if 
af ag 
ax dy” 

Proof. We already know that if system (5.5.4) is Hamiltonian, then (5.5.6) is true. It 

remains to show that if (5.5.4) holds, then there is H(x, y) satisfying 


H 


0 
x'(t)= ree ares. 


(5.5.6) 
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and 
0H 
y(t= gate g(x, y). 
x 


Let us begin with oH — —g(x, y). Then a direct integration with respect to x keep- 
ing y fixed gives 


A(x, y)= = f sc. y)dx + Ci(y), 


where the constant of integration C; may depend on y since H is a function of two 
variables x and y. Once we determine Cj, we can obtain H. Differentiating the last 
expression in H with respect to y and setting it equal to f(x, y) leads to 


0H oa iz 
gre ye —(— g(x, y)dx +C (»)) = f(x, y) by definition 
dy dy 

or 


0 
Cio) = = f ee. vvae+ s0.9). 


Then integrating the last expression with respect to y gives the desired func- 
tion C;(y), that is, 


0 
cioy= f (5 f ets nas)ay+ f to. say. 


The proof will be accomplished if we can show C;(y) does not depend on x. Equiv- 
alently, we can show that the right side of the above expression is independent of x: 


Lf tevndy + f (= [ eee vax)ay] 
=f Lore {22 fos 
= [ Pay +f x(= [se y)dx)dy 


This completes the proof. 


Example 5.4. We already know that the system 


GS Fey a ee 
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is Hamiltonian since af =l= ad = —(—1). Let us now try to find the Hamiltonian 


function H. It follows from Theorem 5.5.1 that 


3 
Ha y== f aes ydx cio) = [Cy yadxtero) =a +010), 


where 
! Y d 2 2 
chon= x f ee ndre fonn=(fcr—s \dx) x+y . 


It follows that C\(y) = 25. Finally, 


Hep 2yh2 2) 
X,y)=x —+->. 
y y 3 3 
Next, we try to explore the stability of an equilibrium solution of a Hamiltonian 
system. We have seen that the autonomous system (5.5.4) is called Hamiltonian or 
conservative if there exists a Hamiltonian function H : Q — R that is not constant on 


any open set in Q, but it follows from (5.5.3) that it is constant on solutions (orbits). 


Theorem 5.5.2. Suppose (5.5.4) is a Hamiltonian system. Then none of its equilib- 
rium solutions can be asymptotically stable. 


Proof. Suppose g is an asymptotically stable equilibrium solution or a point of the 
Hamiltonian system given by (5.5.4). Then there is a neighborhood A of q such that 
for p € A, b(t, p) > gq as t > oo, where P(t, p) is an orbit or trajectory through p. 
However, if the system is assumed conservative with Hamiltonian function H, then H 
is constant on orbits, so H(p) = H(@(t, p)) = H(q) for each p € A. This im- 
plies that H is constant on an open set, which is a contradiction. This completes 
the proof. 


When a Hamiltonian system has an equilibrium point at which the integral has 
a minimum, then an inference of stability can be made. 


Definition 5.5.2. A function E : Q— R is said to have a strong minimum at q if 
there is a neighborhood A of g such that E(x) > E(q) for every x € A except for 
x=q. 


The name strong is implied from the strict inequality. 


Theorem 5.5.3. Suppose (5.5.4) is a Hamiltonian system with equilibrium solution q 
and Hamiltonian function H. If H has a strong minimum at q, then q is stable. 


Proof. Shift the equilibrium solution q to the origin (0, 0). Let A be a neighborhood 
of (0, 0). Let ¢ > 0 be small enough such that the set A = {d: ||d|| =e} C A. Set 


V(d) = H(d) — H(0). 
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Denote the minimum of V on the set A by V,. Now we chose 6 > 0 with 6 < e, so that 
we have V(d) < « if ||d|| < 6. Then we have ||d(t)|| < ¢ for all t > 0. This implies 
that the origin is stable. This completes the proof. 


Next, we state parallel results concerning strong maximums and saddle points. 


Definition 5.5.3. A function E : Q — R is said to have a strong maximum at q if 
there is a neighborhood A of g such that E(q) > E(x) for every x € A except for 
x=q. 


The name strong is implied from the strict inequality. 


Theorem 5.5.4. Suppose (5.5.4) is a Hamiltonian system with equilibrium solution q 
and Hamiltonian function H. If H has a strong maximum at q, then q is an unstable 
saddle. 


Remark 5.5. Note that if (xo, yo) is a critical point of (5.5.4), then it will also be 
a critical point of the Hamiltonian function H. We can use the second derivative test 
again to determine whether or not H (x, y) has a saddle at (xo, yo) or a maximum or 
a minimum there. The Jacobian at the critical point is 
ee ( Hyy(x0, yo) -Ayy(xo, yo) 
—Hyx (x0, Yo) —Hxy(xo, yo) 


Furthermore, 


2 
det J (x0, Yo) = — (Hay (x0, Yo) + Hix (Xo, Yo) Hyy (0, Yo): 


Recall from Section 4.3.1 that if 4; and A2 are eigenvalues of J (xo, yo), not necessar- 
ily distinct, then detJ (xo, yo) = A142. Thus if we assume that none of the eigenvalues 
of the J (x9, yo) is zero, then we have detJ (xo, yo) # 0. 

If detJ (x9, yo) > 0, which is the same as saying that the function H has a strict 
minimum or maximum at (xo, yo), then (xo, yo) is a stable center for (5.5.4) if both 
eigenvalues are negative. This is the case since by Theorem 5.5.2 no critical point of a 
Hamiltonian system can be asymptotically stable. If the both eigenvalues are positive, 
then (xo, yo) is unstable for (5.5.4). 

If det(xo, yo) < 0, the equilibrium point (xo, yo) is unstable saddle for (5.5.4). 


Consider the Hamiltonian system given in Example 5.4. We have already found 
the Hamiltonian function 


x3 y? 
H(x,y)= ee 
(x, y)=xyt+ 3 + 3 


The two equilibrium solutions are (0, 0) and (—1, —1). Define 


2 
Dix, y)= Ay Ayy — (Hy) : 
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Then 
D(x, y)=4xy—-1. 


Now D(0, 0) = —1, and (0, 0) is an unstable saddle. On the other hand, D(—1 —1) = 
3 > 0, and since H,,(—1, —1) = —2 < 0, the Hamiltonian function has a strong 
maximum at the equilibrium solution (—1,—1). Thus by Theorem 5.5.4 (—1, —1) 
is unstable. 

Next, we discuss dissipative systems that we call gradient systems. 


Definition 5.5.4. A planar system of differential equations is called gradient if there 
exists a differentiable function V(x, y) : R? — R such that 


(5.5.7) 


The function V(x, y) is called the gradient function of system (5.5.7). 


The name gradient comes from the fact that system (5.5.7) can be written in the 
form 


X'=-—VV, 


x=(*). VVve= 
y 


For the gradient system (5.5.7), the energy is dissipated. To see this, assume that V is 
an energy function for system (5.5.7). Then if (x(¢), y(t)) is any solution of (5.5.7), 
then 


where 


Ik SIs 


alo oq 


y 


ov, 
ay> 


= (s) +5) <0, (5.5.8) 
av 


2 aV\2 
provided that (5) + a #0. 


Next, we establish conditions for the planar system 


d av, 
A FOO) = rs, +p 


x'= f(x,y), y =, y) (5.5.9) 


to be a gradient system. If (5.5.9) is a gradient system, then there is a function V 
satisfying 


V aV 
—— = f(x,y) and -— = g(x,y). 
Ox dy 
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Assuming that the function V has continuous second-order partial derivatives, we 
arrive at 


a a-V avveeoa 
f a =e (5.5.10) 
oy oxdy dyox dx 


Thus we have shown that condition (5.5.10) is a sufficient condition for system (5.5.9) 
to be a gradient system. The system of differential equations 


x’ =—2xy, y =—-(x*-1) 


is gradient since af =-2x= = Following parallel steps as in Theorem 5.5.1, we 


easily find the gradient function 
Va, y)=xry—y. 


Note that 


dV 
Sy = 2xyx! + @? — Dy! = (4x? y? +? — 71 = Lp + V1 <0 


for v2 + Vv; # 0. As in the case of a Hamiltonian system, if (x0, yo) is a critical point 
of (5.5.9), then it will also be a critical point of the gradient function V. Now we state 
parallel theorems to Theorems 5.5.3 and 5.5.4. 


Theorem 5.5.5. Suppose (5.5.9) is a gradient system with equilibrium solution q and 
gradient function H. If H has a strong minimum at q, then q is stable. 


Theorem 5.5.6. Suppose (5.5.9) is a gradient system with equilibrium solution q and 
gradient function H. If H has a strong maximum at q, then q is an unstable saddle. 


Example 5.5. Consider the system 

x! =—8x3 + 2x, y= —2y +2, 
which is gradient with gradient function 

Vax,y= ay a y = = 2y. 

The system has three equilibrium solutions given by (—1/2, 1), (0, 1), (1/2, 1). Using 
the second derivative test, we find that V has a strong minimum at (—1/2, 1) and 
(1/2, 1). Thus by Theorem 5.5.5 the points are stable for the system. The gradient 
function V has neither a maximum nor a minimum at (0, 1) and hence nothing can 


be concluded about the stability of (0,1). We will see in Chapter 6 that (0, 1) is 
unstable. 
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5.6 Exercises 


Exercise 5.1. Assume that every eigenvalue of ann x n constant matrix A has a non- 
positive real part and that the eigenvalues with zero real part are simple. Suppose that 
g: [0, co) > R” is continuous with 


t 
i lg(s)|ds <0. 
0 
Then show that every solution of 
x'(t) = Ax(t) + g(t) 
is bounded on [0, 00). 


Exercise 5.2. Prove (iii) of Theorem 5.1.4. 


Exercise 5.3. Examine the stability of the zero solution of the given system. 


(a) 
0 2 =/1 
x(t)=[-—2 0 —-1]x; 
0 oO -!Il 
(b) 
1 2 1 
x()=|[ 6 -1 O ]x; 
-1 —2 -1 
(c) 


x (tH)= i: . x. 


Exercise 5.4. Show that the zero solution of the non-autonomous system 


—l+te™ 2+e7 
x'(t)= x 


ee 44 (1+ )% 


_1l 
(+t)? 
is stable. 


Exercise 5.5. Assume all the eigenvalues of the matrix A of system (5.2.3) have 
negative real parts and there is a positive number @ such that ||A(t) — A|| <0 for ¢ is 
sufficiently large. Show that solutions of (5.2.2) are bounded and its zero solution is 
asymptotically stable. 
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Exercise 5.6. Let A be a constant matrix with Re(p(A)) < 0. Choose constants 
K >0O anda <0 such that 


leA"|| < Ke“, t>0. 


Let C be a continuous matrix-valued function such that for positive constant 6, we 
have 


B 
C(t)||< —, t>0. 
IC@I| < gi t= 
Show that the zero solution of 
x’ =[A+C(t)]x(t) 
is 


1. stable if 8 = —a, 
2. unstable if 8 > —a, and 
3. asymptotically stable if 0 < 6 < —a. 


Exercise 5.7. a) Let A be a constant matrix with Re(o(A)) < 0. Let C be a continu- 
ous matrix-valued function on [0, oo). Show that if 


[o,2) 
i |IC@)I|dt <0, 
0 


then the zero solution of 
x’ =[A+C(@]x(1) 
is asymptotically stable. 


b) Use the results of part a) to show that the zero solution of 
u(t) + oe +1)u'(t) + (e+ lu) =0 
+1 


is asymptotically stable for ¢ > 0. 
Exercise 5.8. Give an example as an application of Theorem 5.3.2. 


Exercise 5.9. Show that all trajectories of the system 


() = o)G) 


are periodic and determine their periods. 
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Exercise 5.10. Describe the type of stability of the origin of each system and sketch 
the trajectories. 

(a) x’ =x, y’ =2x+2y; 

baa Sa = yi 

(c)x/=—-x+2y,W=x-Yy; 

(d) x! =—x+y, y’ =2x; 

(e) x’ = 2x — 8y, W =x —2y; 

(f) x! = —3x +2y, yw =—2x. 


Exercise 5.11. Consider the damped harmonic motion represented by the second- 
order differential equation 


mx” +ax' +kx =0, 


where m, a, and k are positive constants. By changing the equation into a system dis- 
cuss the nature and stability of the origin in the following cases: a = 0; a* —4mk = 0; 
a? — 4mk < 0; a” — 4mk > 0. Interpret the results physically. 


Exercise 5.12. Decide whether each system is Hamiltonian or not; in the case it 
is, find the Hamiltonian function. Next, find the equilibrium solutions (if any) and 
classify their stabilities when possible. 

(a) x" +x +2; 

(b) 0” + sin(@) = 0; 

(e) a” a2 = 1; 

(d) x" +2241. 


Exercise 5.13. Decide whether each system is gradient or not; in the case it is, find 
the gradient function. Next, find the equilibrium solutions (if any) and classify their 
stabilities when possible. 

(a) x’ = —4x(x — 1)(x« — 2), y’ = —2y; 

(b) x’ =1—2x, yw’ =—7 —3y; 

(c) x! =3 —2y?x, y’ = —2yx* —4; 

(d) x’ = 4x3 + 4xy, y’ = 2x? 4+2y—1. 
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Nonlinear systems 


In general, nonlinear differential equations are important in applications, and their 
solutions are not known explicitly. Sometimes these equations may be linearized by 
an expansion process in which nonlinear terms are discarded. When nonlinear terms 
make vital contributions to the solution, this cannot be done, but sometimes it is 
enough to retain a few “small” ones. In this chapter, we look for different ways to 
obtain vital information regarding the behavior of solutions. 


6.1 Bifurcations in scalar systems 


In this section, we limit our discussion to the scalar differential equation 


x’ = f(x), (6.1.1) 


where f : R > R is continuously differentiable. We assume that x* is an equilibrium 
solution of (6.1.1). We always assume that the equilibria are isolated, that is, if x* is 
an equilibrium, then there is an open interval containing x* but no other equilibria. 

Fig. 6.1 shows a generic plot of f(x) for x* = a,b,c. The equilibrium solution 
a is an attractor (stable) since arrows to its left and right point toward it. The equi- 
librium solution b is a repeller (unstable) since the arrow to its left and the arrow to 
its right point away from it. Finally, the equilibrium solution c is semi-stable since 
the arrow to its left points toward it and the one to its right points away from it. In 
the case of the equilibrium solution a, we may say that it is locally asymptotically 
stable with respect to small perturbation or deviation from the equilibrium solution. 
To better illustrate the notion, consider the scenario of a population of foxes in a pro- 
tected refuge that is in a locally asymptotically stable state a. Suppose a weather 
event caused a small number of the foxes to die. Local asymptotic stability means 
that the system will eventually return to the original state a. However, if the number 
of dead foxes is big, then the perturbation is not small, and in this event, there is no 
guarantee that the population of foxes will return to the original state a. In the case of 
the population return to state a for all perturbations, no matter how large, the state a 
is called globally asymptotically stable. Such topics will be considered in detail in 
Chapter 7. 

Now we examine the dynamics of (6.1.1) in the neighborhood of its equilibrium 
solution x*. If (6.1.1) is in an equilibrium state x* and y(t) represents a small pertur- 
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graph of 


F(x) 


a b c x 


stable unstable semi-stable 
FIGURE 6.1 


Generic phase line diagram. 


bation from that state, then x(t) = x* + n(t). It follows that x’(t) = n’(t). Thus using 
Taylor series expansion about x*, we have 


x'(t)=n'(t) = f* +n) 
= 7004 FO pat LO 
ie a) ? 


Qt +n—x") +-- 


= f'(x*)n+ 


err ye. 


+... 


FO 


If f’(x*) 40, then the term | f’(x*)n| > | 


O (n?) and higher-order terms for that same reason. Then we arrive at the linearization 
of the system about the equilibrium state x* given by 


|. Thus we may neglect the term 


n'(t) =sn, (6.1.2) 
where s = f’(x*) is the slope of f(x) at x*. Eq. (6.1.2) has the solution 

n(t) =ce™ (6.1.3) 
for some constant c. It is clear from (6.1.3) that if s > 0, then solutions grow expo- 
nentially, and the equilibrium solution x* is unstable. On the other hand, if s < 0, 
then the solutions decay exponentially to zero, and the equilibrium solution x* is 


asymptotically stable and hence is stable. If s = 0, then nothing can be said about the 
stability. Note that different stabilities may be obtained for different systems when 
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s = 0. To see this, we consider the scalar differential equations 


x! =x’, x= —x?, x! =x, and x’ =—x?. 
All they share the equilibrium solution x* = 0 and s = f’(0) = 0. Consider the first 
equation with f(x) = x*. Then f’(x) = 2x, which is negative for x < 0 and positive 
for x > 0. Thus by the previous discussion the arrow to its left points toward x* = 0, 
and the one to it right points away from it. It follows that x* = 0 is semi-stable. By 
similar arguments we find that x* = 0 is semi-stable for the second equation, unstable 
for the third equation, and stable for the fourth equation. 


Example 6.1. If x(t) represents a population at time t, r > 0 is the growth rate, and 
K > Ois the carrying capacity, then the logistics model of the population growth is 
given by 


x'=rx(1—~) (6.1.4) 
= ran Al; 
Setting the right hand of (6.1.4) equal to zero, we arrive at two equilibrium solutions 


x*=0, K. 
. 2. 
Let f(x) =rxd —- hi Then f’(x) =r— ae It follows from (6.1.2) that 


s= f’O)=r and s= f'(K) =-,r. 
We conclude that x* = 0 is unstable and x* = K is stable. 


Although the dynamics of scalar differential equations is simple, since both so- 
lutions converge to a constant or become unbounded as t — oo, they can have some 
interesting behaviors if solutions depend on some embedded parameters. To be spe- 
cific, when the parameters are varied and pass some critical values, the systems 
may experience some abrupt changes or undergo some qualitative changes. These 
qualitative changes are called bifurcations, and the parameter values at which the bi- 
furcations occur are called bifurcation points. We are interested in scalar differential 
equations of the form 


x’ = f(x, 1), (6.1.5) 


where f is continuous in both arguments, and yz € R is a parameter. 

Thus the system is said to undergo a bifurcation as jz crosses some critical value 
lo if, in some way, the nature of the solutions changes qualitatively between the 
regions ju < 49 and yt > Lo. 

Three most important one-dimensional equilibrium bifurcations are described lo- 
cally by the following differential equations: 


x’ =—x7, saddle-node: 
x’ = x —x?, transcritical; and 


x’ =x —x°, pitchfork. 
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FIGURE 6.2 


Bifurcation diagram determined by x’ = pu — x2. 


We will study each of these in more detail. We begin by considering saddle node 
bifurcation, which is the basic mechanism for creation and destruction of fixed points. 
As parameter varies, two fixed points move toward each other, collide, and mutually 
annihilate, that is, the saddle-node bifurcation results in fixed points being created or 
destroyed. 


Example 6.2. Consider the scalar differential equation with parameter jz 


xe Spa": (6.1.6) 


Clearly, there are no equilibrium solutions for 4 <0, and x* = +,/u for ps > 0. 
It is clear that s = f’(./m) = —2,/u < 0 and s = f’(—./m) = 2,/u > 0, which 
imply that the solid bold branch x = ,/j is stable and the dashed branch x = —,/j is 
unstable. The bifurcation diagram is shown in Fig. 6.2, and since there is an exchange 
of stability at 4. = 0, we have a bifurcation at 4. = 0. This type of bifurcation is known 
by the names saddle node bifurcation, fold bifurcation, turning point, and blue-sky 
bifurcation. Note that at the bifurcation point 4 = 0, s = f’(0) = 0, and hence the 
linearization term disappears when equilibrium solutions coalesce. 


Remark 6.1. In (6.1.6) of Example 6.2, if we change the term —x? to x”, then 
x= w+ rie 


There are no equilibrium solutions for jz > 0, and the curve y = 4+.x? does not inter- 
sect the x-axis. As « \, 0, the graph y = jz + x? intersects the origin tangentially, and 
we have one equilibrium solution. As jz becomes negative, two equilibrium solutions 
appear at x = +,/—w. Then, using the stability indicator s, we see that x = —,/— 
is stable and x = ./—j is unstable. We conclude there is a saddle node bifurcation at 
(0, 0) as indicated in the bifurcation diagram shown in Fig. 6.3. 


Next, we discuss a class of bifurcations that occur as stability changes when going 
from one equilibrium solution to another. This type of bifurcation is called transcrit- 
ical bifurcation. 
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unstable Xn 
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oie = 
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> 
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FIGURE 6.3 
Bifurcation diagram determined by x’ = w+ x2. 
x x x 
(a) <0 (b) w=0 (c) uM >0 


FIGURE 6.4 


Phase portraits for different values of jw. 


Example 6.3. To illustrate the idea, we consider the population growth model with 
carrying capacity 


x! = px —x?. 
The system has the equilibrium solutions x* = 0, w. Using s = f’(x*), it follows that 
x* = O is stable if uw < 0 and unstable if 44 > 0. Similarly, x* = y is stable for 4 > 0 
and unstable for jz < 0. Fig. 6.4 shows the phase portraits for different values of ju. 
Also, Fig. 6.5 shows the bifurcation diagram. The stable branches are shown by bold 
solid lines, and the unstable branches are shown by dashed lines. 


Next, we discuss a type of bifurcation called pitchfork bifurcation. The name 
comes from the shape of the bifurcation diagram that resembles a pitchfork. This 
type of bifurcation is common in problems that have a symmetry, for example, the 
buckling beam. In the case of pitchfork bifurcation the equilibrium solutions tend to 
appear and disappear symmetrically, creating a type of bifurcations that are different 
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FIGURE 6.5 


Bifurcation diagram that shows (jw, x) = (0, 0) is a transcritical bifurcation point. 


from those that we have already discussed. Pitchfork bifurcations can come in one of 
two types, in the supercritical bifurcation and in the subcritical bifurcation. 
Supercritical bifurcation is typified by equations of the form 


x’ =px —x?. 
For yz < 0, the origin is the only equilibrium solution, and it is stable. On the other 
hand, for jz > 0, the origin is unstable, and the other two equilibrium solutions +,/u 
are stable. 
Similarly, subcritical bifurcation is typified by equations of the form 


x’ = px +x. 


For ju < 0, the origin is stable, and the other two equilibrium solutions +,/m are 
unstable. On the other hand, for jz > 0, the origin is the only equilibrium solution, 
and it is unstable. 


Example 6.4. We consider the scalar differential equation 


x’ =px —x?. 

It is clear that x* = 0 is an equilibrium solution regardless of the sign of 4 and x* = 
+,/p only if 1 > 0. Note that for any fixed value of jz, the function y = wx — x? is an 
odd function in x. Hence critical points will appear and disappear symmetrically with 
respect to the origin, or the system has the left-right symmetry. Using s = f’(x*) = 
pu — 3(x*)’, it follows x* = 0 is stable for  < 0 and unstable for jz > 0. In addition, 
s= f(4£,/) = —2u < 0 implies that the equilibrium solutions +,/j are stable. The 
bifurcation diagram is displayed in Fig. 6.6. 

Fig. 6.6 indicates that two stable equilibrium solutions or branches are created at 
the bifurcation point (0, 0) and still exist after the bifurcation. A similar remark can 
be drawn regarding the subcritical bifurcation. 
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FIGURE 6.6 


Bifurcation diagram determined for x’ = zx — x?; supercritical bifurcation at (0, 0). 


The next theorem is the scalar version of the implicit function theorem. 


Theorem 6.1.1. For scalar system (6.1.5), suppose that f : IR x R— R with contin- 
uous first partial derivatives. Suppose xo is an equilibrium solution at [u9, meaning 
that f (xo, 40) = 0. Assume that 


f (xo, Ho) = 0, L(x, Lo) # 0. 
Then there exist 6, ¢ > 0 and a C!- function 
X: (U9 —€,Uo+e)>R 
such that x = x is the unique solution of 
f(x, uw) =0 
with |x — xo9| <6 and |u— po| <€. 


For bifurcation theory, we have the following important result. 


Corollary 6.1. Suppose that f :R x R > R has continuous first partial derivatives. 
Suppose xo is an equilibrium solution at {40 for (6.1.5). Then a necessary condition 
for a solution (xq, (Lo) of (6.1.5) to be a bifurcation point of equilibria is that 


0 
Lo, Lo) = 0. (6.1.7) 
x 


The next theorem provides necessary conditions that guarantee the different types 
of bifurcation points we have discussed so far. 
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Theorem 6.1.2. Suppose that f :R x R => R is continuous in both arguments and 
has continuous first and second partial derivatives. Suppose that at (x0, 0), f sat- 
isfies the necessary bifurcation conditions 


of 
Sf (xo, Ho) =9, (xo, Mo) = 0. 
Ox 
(1) If 


d a? 
se (x0, Ho) #0, uaa (xo, Ho) #0, 
LL ox 


then a saddle node bifurcation occurs at (x0, Lo). 
(2) If 
a a? a” 
oF xo, wo) = 0, SF Gags #0, oF xo, wo) #0, 
Ou OxdL ox 


then a transcritical bifurcation occurs at (x9, Lo). 
(3) If 


af O° f 
i, ’ = 0, ar, a ’ = 0, 
an Ho) 5x2 (x0, Ho) 


af arf 
a i] 0, a a 9 0, 
axon Mo) # 5x3 (x0, Ko) # 


then a pitchfork bifurcation occurs at (xo, (40). In addition, 
43 
(i) if TL (xo, Lo) < 0, then there is a supercritical bifurcation at (xo, 40), and 


3¢ 
(ii) if *L (x0, Lo) > 0, then there is a subcritical bifurcation at (xo, [o). 
Example 6.5. We consider the scalar system 
i x 
x’ = px —e*. 
Then its bifurcation points must satisfy 
px —e=0. 


Plotting the graphs y = wx and y = e’, we see that the line y = x is tangent to the 
curve at (x, y) = (1, e). In other words, if we set f(x, 4) = wx —e*, then f(1, e) =0. 
This says that x9 = 1 is an equilibrium solution for 4 = e. Moreover, (1, e)=0. 
In addition, sE (x0, Lo) = 1 £0, and FS (ao, Lo) = —e £0, and so by item 1 of 
Theorem 6.1.2 there is a saddle node bifurcation at (1, e). 


Remark 6.2. Suppose bifurcation for (6.1.5) occurs at (xo, 40). We may translate to 
the origin (0, 0) by the change of variables x > x — x0, uU — uu — Mo. Moreover, if 
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xX = X() is a solution branch, then x — x — x(j2) maps the branch to x = 0. Suppose 
we have a saddle node bifurcation. For (0, 0) to be a bifurcation point, we must have 


of 
f (xo, Ho) =9, (Xo, Mo) = 0. 
Ox 
Further, suppose that 


a a? 
°F 0,0) =a #0, 7S 0,0) =b£0. 

Op ax2 

Then if in the Taylor expansion of f(x, 4), we neglect quadratic terms in jz and cubic 
terms in x, then near (x, 4) = (0, 0), we obtain 


<9 J0F of eae 
S(%, B) aoe A Pa = Rat it +::: 
=an+tbxr+---, (6.1.8) 


The form ay + bx? in (6.1.8) is called a normal form or representative for scalar 
saddle node bifurcations. Thus the original system may be approximated near the 
origin by 


x’ =apt+ bx. 


The signs of a and b determine the type of bifurcations and the shape of the bifurca- 
tion diagrams as shown in Example 6.2 and Remark 6.1. 


We end the section with the following application. 


Example 6.6. (Bucking of a rod) The potential energy of the system of two rigid rods 
of length LZ connected by a torsional spring with spring constant k is given by the 
function 


R(x) = she + 2AL(cos(x) — 1), 


where A is the strength of compressive force, and x is the angle of the rod to the 
horizontal axis. The term 5kx? is the energy required to compress the spring by the 
angle 2x, and 2A. L ( cos(x) — 1) is the work done on the system by the external force. 
Equilibrium solutions satisfy R’(x) = 0 or 


: 2A0.L 
x — wsin(x) = 0, as : 


where jz is a dimensionless force parameter. The above equation has the unbuckled 
equilibrium solution x = 0. Set 


f(x, m) = R(x) = psin(x) — x. 
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Then the necessary conditions for an equilibrium bifurcation are 


which occurs at jz = 1. By finding the Taylor series of f at (0, 1) we arrive at 


1 
F(x, MW) = (w— Dx gx? to 


We can see from Example 6.4 or verifying the conditions of item 3 of Theorem 6.1.2 
that there is a pitchfork bifurcation at (x, w) = (0, 1). The bifurcation equilibria near 
this point are given for 0 < ~—1< 1 by 


x= /6(u—1)4+---. 


This can also be seen by plotting the graphs y = x and y = psin(x). 

This simple one-dimensional problem is an illustration for the buckling of an 
elastic beam, one of the first bifurcation problems which was originally studied by 
Euler in 1757. 


X] 
x2 n 
For the rest of this chapter, ifx = | | ], then |x| = > |x;|, and for ann x n 
: i=1 
Xn 


n 
matrix, A = a;;, |A| = > lai;\. 
i,j=l 


6.2 Stability of systems by linearization 


Consider the general system of ordinary differential equations 


x4 = fii, “+ -sXn), 
xy _ f2(%1, ili -sXn), 
Xn = fay «+5 Xn)- 
Using the vector notations 
x1 
X2 
eS 
Xn 
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and 

fi) 

fax) 

f@=] . |, 

fn(x) 

the above system can be written in the vector form 
x’ = f(x), (6.2.1) 

where f : R” — R"” with continuously differentiable components. We assume that 
the vector x* = (xf, x>,...,x;) is a fixed point of (6.2.1). 


Define the linear part of f at x* by J(x*), where 


sO) gee GE) 
Of2 (y* Ofary*) .., Of2(y* 

JG") = a an are? : (6.2.2) 
pe(x*) Gt) FBG) 


which is called the Jacobian of f at x*. Since f € C!(R", R”), Taylor’s theorem for 
functions of several variables says that 


f (x) = J(x*) (x — x*) + g(x) (we have used f (x*) = 0), (6.2.3) 
where g is a function that is small in the neighborhood of x* in the sense that 


km 18%! 
im 


x—>x* |x — x*| = 


(6.2.4) 


Note that since f(x*) = 0, (6.2.3) implies that g(x*) = 0. Our hope is to prove that 
if Re(o(J(x*))) < 0 or the origin for 


yaIR yy 


is asymptotically stable, then the equilibrium point x* of (6.2.1) is asymptotically 
stable. Note that by introducing the transformation y = x — x* we may assume with- 
out loss of generality that the fixed point is at the origin. Thus we have the following 
general theorem. 

Theorem 6.2.1. Assume that Re(p(A)) < 0 where A is ann X n constant matrix. 
Let U be an open set of R x R" that contains (0,00) x B,(0), where B,(0) = {x € 
R” : |x — 0| <r} for positive constant r. Assume that g : U > R" is continuous in 
both arguments and Lipschitz in the second argument such that 


km (8%)! 
im —_—_— 
x30 |x| 


= 0 uniformly for t € [0, 00) (6.2.5) 
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with g(t, 0) = 0. Then the origin for the perturbed nonlinear system 
x’ = Ax + g(t, x) (6.2.6) 
is asymptotically stable. 
Proof. Since Re(p(A)) <0, we can find constants K > 0 and é < 0 such that 
ljeA"|| < Ke’, t>0. 


Let x(¢) be a solution of (6.2.6) on some interval (a, b) containing 0 with x(0) = xo. 
Then the variation of parameters formula (3.3.6) yields 


t 
x(t) = eA) x9 4 , eAl—5) o(5, x(s))ds. (6.2.7) 


0) 


Taking the appropriate norms of both sides of (6.2.7) and estimating give, for t > 0, 
t 
in| = Kole + [Ke ig(s,x(6))lds, 1 € (0.6). 
0 
Multiplying both sides by e~*’, we arrive at the expression 
t 
In(le = Klxol +f Ke |g(s,x6e))ids, 1 € 10,0). 
0 
Chose n > 0 such that 7K < —&. Thus by (6.2.5) we have that 
|g(t,x)| < n|x| for (t,x) €[0, 00) x B,(0). 
Set 6* = 6/(2K + 1) < 6. Suppose that |x| < 6*, and let (a,b) be the maximal 
interval of existence with x (0) = xo. 
Let [0, c] € (a,b) be an interval such that |x(t)| < 6 for all t € [0,c]. This is 
possible due to the continuity of x. By the above inequality of g we have that 
Ig(t,x)| < n|x| fort € [0, c]. 
Then we have 
t 
|x(t)|e~*! = K |xo| + / Ke-*'n|x(s)|ds, t €[0,c]. 
0 


Use Gronwall’s inequality and then evaluate the integral to get 


1 
Ix(t)|e~*! < K?|xoln—[e*™ — 1] 
Kn 


= K|xoleX™. 
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Knt 


Since |x| < 6*, K|xo| < 6, and so |x(t)|e7*! < de". It follows that 


[x(t)| < deSt*™ | ¢ €[0, cl, (6.2.8) 


where € + Kn <0. 

Of course, we only showed that inequality (6.2.8) holds for |x(t)| < 6 on [0, c]. It 
is left as an exercise to show that the inequality holds on [0, 00). This completes the 
proof. 


Remark 6.3. (1) If the origin is stable for the linear system x’ = Ax but not asymptot- 
ically stable, then it is not necessary that the origin is stable for the nonlinear system 
(6.2.6). 

(2) If the origin is unstable for the linear system x’ = Ax, then it is unstable for the 
nonlinear system (6.2.6). 


Remark 6.4. Let D C R” containing the origin. Consider the autonomous system 
x’ = f(x), (6.2.9) 


where f : D > R" with continuously differentiable components and f (0) = 0. Let 
A = J(0) be the Jacobian matrix of f at x = 0. Rewrite (6.2.9) as 


x’ = Ax + g(x), (6.2.10) 


where g(x) = f(x) — Ax. The differentiability of f implies g(x) = 0(|x|) as x > oo. 
Therefore g(x) satisfies condition (6.2.5). 


The next theorem provides results concerning the UAS of the zero solution. Its 
proof is left as an exercise. 


Theorem 6.2.2. Assume that Re(p(A)) <0, where A is ann Xx n constant matrix (or 
the zero solution of the linear part is AS). Assume that a continuous function g(t, x) 
satisfies Lipschitz or local Lipschitz condition in the second argument for x € D. 
Suppose that 


ki lg(t, x)| 
1m —— 


x30 |x| 


=0 uniformly for t € [0, 0) (6.2.11) 
with g(t, 0) = 0. Then the origin for the perturbed nonlinear system 
x’ = Ax + g(t, x) 
is uniformly asymptotically stable. 
We have the following example. 
Example 6.7. The zero solution of the nonlinear non-autonomous system 


t 
c= Se 
t+1 
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is UAS. It is obvious that the zero solution of the linear part x’ = —x is AS. We must 
show that condition (6.2.11) holds. Let g(t, x) = ae Then g is continuous, and 


for any open subset D = (a, 6) C R containing the origin, we have 
Ig(t, x) — g(t, y)| S 2B |x — y| forall (t,x), (¢, y) € [0, 00) x D. 


Moreover, 


2 
ae : x 

lim Is@ 0) < lim 

x0 |x| x0 |x| 


= 0 uniformly for ¢ € [0, 00). 


Thus by Theorem 6.2.2 the zero solution is UAS. 


The next example shows the needs for a different approach when the eigenvalues 
of the matrix A fail to have negative real parts. 


Example 6.8. Consider the planar autonomous system 


x’ = —y+x4/x2 + y?, yl =xtyyfx2 + y?. 


It is clear that (0, 0) is the only equilibrium point. We rewrite the system in the form 
6-0 DOVE 
y 1 O/\y yl x2 + y2} 
0 -l 
s=(1 9) 


are ti. Thus Theorem 6.2.1 does not apply. Instead, we use the polar coordinates. 
Namely, 


The eigenvalues of 


x =rcos(@), y=rsin(@), where raxe+ y, 


and r = r(t) and 6 = 6(t) = tan~'(2). Thus 
d 2 2 d 2 
a sar 
or 
xx’ + yy =rr’. 


A substitution of x’ and y’ yields 


rr’ = x(—y + x4/ x7 + y2) + w(x + yy x? + y?) 


=O? +y?)/x? + y? 
= r2 


r. 
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Thus we have the first-order differential equation 
r=r’, (6.2.12) 


which implies that the function r is increasing. Thus trajectories are spiraling away 
from the origin, and hence the origin is unstable. In addition, 


_ xy xy © 


6g’ 
x24 y? 


1. 

Choosing 6(0) = 0, we have 6(t) = t, which indicates trajectories spiral away from 

the origin counterclockwise. Note that using separation of variables, (6.2.12) can be 
1 


easily solved to find r(t) = ;-; for some suitable constant k. Notice that r(t) + oo 


ast—>k-. 


Example 6.9. In Example 3.5, we considered a pendulum with friction and arrived at 
the planar autonomous system 


oe 
=== sini = an (6.2.13) 
L m 


It is clear that system (6.2.13) has infinitely many equilibrium points (nz, 0), n = 
0, 1,..., which correspond to vertical positions with zero velocity. We will only an- 
alyze two equilibrium points (0,0) and (zr, 0). For the equilibrium point (0, 0), we 
write system (6.2.13) in the form 


Pal c 0 1 x1 8 0 
x) ~\-e —2)} ao) Fr le — sine) 


The linear part has the eigenvalues 


b 1,b7 £\1/2 
AL= 4 
, ae D) 
and 
b 1,b? &\1/2 
M= 4 : 
; 2m le 7, 


If a = 4¢ < 0 (when damping is weak), then the eigenvalues are complex with 


negative real parts, and the origin is a stable spiral. If a = 4¢ > 0 (when the damping 
is strong), that is, 
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we have that A2 < A; <0, and hence the equilibrium solution (0,0) for system 
(6.2.13) is asymptotically stable by Theorem 6.2.1. 

The physical and geometrical interpretation for (x1, x5) = (0,0) being a stable 
spiral corresponds to the pendulum hanging vertically downward (x; = 0) with zero 
velocity (x5 = 0), and thus, when the damping is weak, a perturbation will cause the 
pendulum to spiral and approach the vertically downward position. 

For the equilibrium point (zr, 0), we use the transformation 


X1\_ fi 1s 
eG) 
(3!) = a 
y2 & sin(yy) — 2 yo) 


To examine this system near (0, 0), we write the above new nonlinear system in y in 


the form 
()-( )G)-6-2 
y2 B 2] \y} L yi — sin(y,)) 


The linear parts have the eigenvalues 


in (6.2.13), obtaining 


b b? 
4 ae 


> 


b b? é )! jp 
2m m L , 
It is clear that A2 <0 < A; and the equilibrium point (0,0) and hence (z, 0) are 
unstable. 
Note that we could calculate the Jacobian given by (6.2.2) at (a7, 0) and obtain 


0 1 
I(T, 0)= |, >|? 
Lom 


instead of using transformation. 
If we compute J((+n7,0)), then we will see that (nz, 0) are stable for n = 
2,4,... and unstable forn = 1,3,.... 


Example 6.10. (Lotka—Volterra predator-prey model) In Example 4.1 we considered 
the Lotka—Volterra system 


dx _ b 
Tp ok ~ OXY 
y 
i d 6.2.14 
P cy + dxy ( ) 
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and found that the equilibrium solutions are 
xj} = (0,0) and x} = (c/d,a/b). 


The first equilibrium solution xj effectively represents the extinction of both species. 
If both populations are at 0, then they will continue to be so indefinitely. The second 
equilibrium solution x; represents a fixed point at which both populations sustain 
their current, non-zero numbers, and do so indefinitely. The levels of population at 
which this equilibrium is achieved depend on the chosen values of the parameters 
a,b,c, and d. Now we will further discuss the stability of both equilibrium solutions 
xj and x; and hope that x} is unstable and x3 is stable. The Jacobian matrix is 


_ (a—by —bx 
1o.n=( dy a8) 


J, 0) = (‘ o 


with eigenvalues a > 0 and —c < 0. Thus the equilibrium point (0, 0) is a saddle and 
hence unstable. 
For x3 = (c/d, a/b), 


For xf = (0, 0), we have 


0 -% 
Neld.aloy=( i,“ ). 


b 

which has purely imaginary eigenvalues. Hence linearization is inconclusive. Note 
that the use of polar coordinates will not work here in the sense that it is hard, if not 
impossible, to obtain any information from it. We look at the vector fields surrounding 
the equilibrium point by dividing the region of interest into four quadrants as depicted 
in Fig. 6.1. We do so by drawing vertical and horizontal lines through the equilibrium 
point (c/d, a/b). Those lines are called the x and y nullclines. We begin by writing 
system (6.2.14) in the form 


x’=x(a—by), y’ =y(-—c+dx). (6.2.15) 


The x nullclines for system (6.2.15) where x’ = 0 are x = 0 and y = ¢. Trajectories 
cross these two lines vertically. Similarly, trajectories cross the y nullclines where 
y’ = 0 horizontally. We see that the equilibria are the intersections of the x and y 
nullclines. On the ray to the left of the equilibrium and below the line y = a/b, we 
have x < 5 and y = §. We know that the vector field is vertical, and so we only need 
to check the sign of y’. From (6.2.15) we have 


t=jaehaya eta < Cote jS0 
= = x)= —-(-—c Xx =(=C T)=NU. 
an ee b b d 
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Vx 
y—nullcline 
x <0 ; x <0 
y<0 — y>0 
1 
_ *. 
1 
1 
1 
1 
1 
1 x—nullcline 
a/b peewee eee ee eee ee Ce 
I 
1 
1 
1 
1 
1 
x >0 \ : Pi x >0 
y <0 i— y>0 
1 
1 
1 
. > 
(0,0) c/d * 
FIGURE 6.7 


Nullclines and vector field. 


Thus in that region, we have that x’ > 0 and y’ < 0. Similarly, if we consider the 
region to the left of the vertical line x = § and above the horizontal line y = c/d, 
then we have that x = 5 and y > $. Again, the vector field is horizontal, and we only 


need to check the sign of x’. From (6.2.15) we have 


c a 
— b b—)=0. 

x =x(a— by) < —(@—b7) 

Thus in that particular region, we have x’ < 0, y’ < 0. This task can be easily per- 

formed for the other two regions. The complete vector field around the equilibrium 


is displayed in Fig. 6.7. To obtain the trajectories, we write the system in the form 


dy _y(-c+dx) 
dx x(a —by) © 


a 
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After rearranging the terms, we get 


—b = 
(aby) ,,_ Getdx) 
y XxX 


Simplifying and then integrating both sides yield 
aLn(y) — by = —cLn(x) +dx-+K for some constant K. 


Exponentiating both sides gives 


yte Py = xed XK 


We consider the y nullcline where the value of x is fixed at c/d. We choose a specific 
trajectory by assigning a fixed value for K. Then the right side of the above relation 
is positive , so that 


y? = Be”. (6.2.16) 


The left and right sides of (6.2.16) are the power and exponential functions, respec- 
tively. Therefore if we plot them on the same graph, then there can be at most two 
crossings, or Eq. (6.2.16) can have at most two solutions for y. Thus along the y 
nullcline, there can be at most two crossings. That means that an orbit or trajectory 
cannot spiral into or out from an equilibrium point. Otherwise, many values of y 
would be required, which is not the case here. This determines that the equilibrium 
point (c/d,a/b) is encircled with periodic trajectories, and hence it is stable. Note 
that the periodic trajectories encircling the equilibrium point (c/d, a/b) indicate that 
a small perturbation from the equilibrium solution puts the populations on a peri- 
odic orbit that stays near the equilibrium and the system never returns to equilibrium. 
A phase diagram is shown in Fig. 6.8. 


6.3 An SIR epidemic model 


Here is the perfect place to apply what we have studied so far to an SJR model, 
where 


S = S(t) is the number of susceptible individuals (not yet having the disease but 
capable of getting it) 

I = I(t) is the number of infected individuals, and 

R= R(t) is the number of recovered or removed individuals. 


We assume that the total population is constant and everyone is susceptible. Then 
S+1I+R=N (constant), 


that is, 


S+1+ R= 1 (by normalization). 
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FIGURE 6.8 


Prey—predator dynamics as described by the level curves. The arrows describe the velocity 
and direction of solutions. We chose a=b=c=d=1. 


Let 


jz = birth rate = death rate (because the number of people is constant), 
y = removal rate, and 


A = infection rate. 
We assume that all newborns are susceptible and arrive at the epidemic model 


SQ) =(StI+R)u— pS — (SDA, 
'@)=—pl —yI+ASiI, 
R(t) =—pR+ yl. 


We have (S + J + R)u = p, since the population is constant and normalized at 1. 
The term of wz S represents the death of susceptible, and the negative implies loss or 
removal from being susceptible. On the other hand, the term (S/)A denotes those 
who got infected, and the minus represents that they are infected and not susceptible 
anymore. Similarly, the term jz/J represents those who die from the infection, and the 
minus indicates a loss for those who are infected already. In addition, the term y/ 
indicates those who are removed from the population due to beating the epidemic or 
got vaccinated. Finally, the term .R denotes those who are removed due to death. 
Keep in mind that minus means loss from a certain class for S$, 7, and R, and plus 
implies gain for the same classes. Thus by only analyzing S > 0 and J > 0 we arrive 
at the 2 x 2-planar system 


a — — 
ee eA (6.3.1) 


Po-(ebyil +35 
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Note that system (6.3.1) is nonlinear and (0, 0) is not an equilibrium solution. Also, 
the system is valid in the region 0 < S + I < 1 since we are neglecting R. It is 
important to note that the system does not allow those who recover from the epidemic 
to become susceptible again. Suppose S(t) = So and J (to) = Jo. Since the right side 
of (6.3.1) is continuous with continuous first partial derivatives, we know that the 
solutions S(t, fo, So) and I(t, fo, Ig) exist and are unique. Moreover, S(t, fo, So) and 
I(t, to, So) are continuous and differentiable with respect to all variables. Next, we 
examine how big the interval on which the solutions exist. Due to our constraints, we 
are interested in the triangular region of existence 


T={(S,1):S>0,1>0, S+I <1}. 


Along S = 0, we have S’=y >0,0</ <1l,andl’=—-(u+y)I <O0if 7 >0. 
Moreover, 


Thus any trajectory that starts on the J-axis moves downward inside T in the positive 
direction of S. 

Now, along J = 0, we have S’ = u(u — S) > 0,0 <7 <1, and I’ =0. Thus any 
trajectory that starts on the S-axis moves toward the point (1,0), at which the line 
S + I =1 intersects the S-axis. Note that (1, 0) is an equilibrium solution. 

Along the line S + J = 1, we have 


(StI =S + =p-p(S4+))-yl, 
and since S$ + J = 1, this expression reduces to 
(StI) =-ylI <0. 


This tells us that any trajectory starting at the line S + J = 1 moves to the left of the 
line toward the inside of the triangle 7. We conclude that the triangular region T is 
positively invariant, that is, if (So, Jo) € T, then S(t, to, So), T(t, to, Io) € T for all 
t > to. Thus the maximum interval of existence for solutions in T is [t9, co). From 
now on we refer to the triangular region T as the feasible region. Next, we search for 
the equilibrium solutions (S*, /*) in the feasible region. To do so, we must solve for 
S and I by setting the right sides of (6.3.1) to zero, that is, S’ = 0, and I’ = 0: 


uw—-wS—AST=0, and —(u+y)I+AST=0. 
From the second equation we obtain 
(—w—y +AS)1=0. 


Thus if J 4 0, then we arrive at 
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Clearly, S* > 0, and in order for S* to be in the feasible region, we must have 
b+y <A. 
Substituting S* = foe into the equation  — 4S* — AS*I* = 0, we arrive at 


fa... 
uty aA 


It is clear [* > 0, since 


pot pa 
bMt+ty A A KX 


Next, we show that (S*, /*), belongs to the feasible region: 


(294 Pper" 4 oP 
Xr ety av 
iG, ti, 1 
nH pty 
Fa = 
bry Ury 


Thus the two equilibrium solutions (1, 0) and (S*, /*) belong to the feasible region T. 
Next, we use Theorem 6.2.1 to study the stability of the two equilibrium solutions. 
We do not want solutions to approach (1,0) and stay there. Instead, we rather have 
that solutions approach (S*, /*), that is, we hope for (1, 0) to be unstable. 

We begin with (1, 0). The Jacobian matrix is 


us.) =( 


yee wl ahs 
ur —(uty)+aSs}° 


Thus 
=i = 
Jd,0)= 
on & eee, 
with two eigenvalues 
dj =—p and dg=—(u+y)+A. 


Clearly, d) < 0, and dz > 0 as long as 4 + y <A. Thus by Theorem 6.2.1 the equi- 
librium solution (1, 0) is unstable. Recall that if 


(3) 
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is a nonsingular matrix, then the characteristic equation is 
? — (a +d) + ad —bc=0. 
By introducing 


p=a-d, 
q=ad — be, 


the characteristic equation becomes 
* — prtq=0. 


The roots of this equation are 


Nile 


A12= 


E +,4/ p?- 4a] : (6.3.2) 


Now the Jacobian at (S$*, /*) is 


eS ee a 
1s", 1*)=( ae ; ). 


Using (6.3.2), we arrive at the two eigenvalues 


_ Qt al) (e+ AT)? — 4028" T* 


d 
1,2 5) 


with negative real parts. Hence by Theorem 6.2.1 the equilibrium solution (S*, /*) is 
asymptotically stable. 


6.4 Limit cycle 


A central issue in the theory of nonlinear systems in differential equations is to de- 
termine the existence of closed orbits or limit cycles. Those closed orbits or limit 
cycles represent periodic solutions of the system. We consider the two-dimensional 
autonomous system 


# = PO; y), 5 = 06,9), (6.4.1) 


where P and Q are continuous on some subset of R*. Systems given by (6.4.1) may 
admit solutions that commonly tend to a limiting finite periodic solution. This limit- 
ing closed curve in the phase plane is called a limit cycle. 


Definition 6.4.1. A limit cycle of system (6.4.1) is a closed curve, and no other 
solution that is a closed curve exists in its neighborhood. 
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Note that every neighboring trajectory spirals and approaches the limit cycle from 
the inside or from the outside as t > 00 or as tf > —oo. 


Definition 6.4.2. If every neighboring trajectory approaches a limit cycle as t > oo 
or as t + —ox, then the limit cycle is said to be stable. 


It is hard, if not impossible, to determine if a nonlinear system admits a limit 
cycle. However, the next result, known as Bendixson—Dulac criteria should provide a 
criterion for the nonexistence of limit cycles or closed trajectories of the system given 
by (6.4.1). 


Theorem 6.4.1. (Bendixson—Dulac theorem) Suppose the first partial derivatives of 
P(x, y) and Q(x, y) are continuous on some connected subset U in R?. If 


dP dQ 

ox dy 
is not identically zero and has the same sign in any open set of U, then system (6.4.1) 
has no closed trajectory in U. 


Proof. Suppose the contrary, that is, there is a closed curve C in U. Then by Green’s 
theorem we have 


Le y)dy — OG, ydx=f [+3 oe aiay (6.4.2) 


where R is the region enclosed by C. Let x = x(t), y = y(t) be a parameterization 
of C. Then 


[Pe y)dy — O(x, yar f° (po — oar, 


where T is the period of C. Using (6.4.1), we arrive at 


F 
Lee y)dy — Q(x, ydx -|[ (PQ —QP)dt =0 


[G+ Qa 0, 


which can only hold if af + so is zero or changes sign, which is a contradiction. 
Thus C cannot be close, and the system does not admit a limit cycle. This completes 
the proof. 


Thus from (6.4.2) we have 


Example 6.11. Let g and h be differentiable functions. Consider the two-dimensional 
system 


x'=g(y), y =(1+2x7)y +(x). 
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Then 
dP 0daQ 


4} 2145750, eR, 
an ay +x > x 


and by Theorem 6.4.1 the system does not admit a periodic solution. 


The next theorem generalizes Theorem 6.4.1. For its proof, we refer the reader to 
Exercise 6.20. 


Theorem 6.4.2. (Generalization of Bendixson—Dulac theorem) Suppose the first par- 
tial derivatives of P(x, y), Q(x, y), and h(x, y) are continuous on some connected 
subset U in R?. If 
d(hP) a d(hQ) 
ox dy 


is not identically zero and of one sign in any open set of U in R?, then system (6.4.1) 
cannot have a closed trajectory in U. 


We have the following example as an application. 


Example 6.12. For constants a, b, c, k, consider the two-dimensional system 
x'=(y—a)x, vy =bx+cy + ky’. 


Then 


oP oO 
OE gO a5, phish, 
ox dy 
and hence Theorem 6.4.1 is not applicable. Let us try Theorem 6.4.2 with h(x, y) = 
x kt) Then 
a(hP a(h 
(hP) 4 (hQ) = (c-+ 2ka)x~ 2) 2.9 
Ox dy 
if c+ 2ka 4 0, and by Theorem 6.4.2 the system does not admit a periodic solution 
in the half-plane x > 0 or x <0. 

In fact, we can do better. If x = 0, then starting from any point on the y-axis, the 
equation has a solution that lies on the y-axis. Thus we conclude that the equation 
has no closed cycle or trajectory and hence a periodic solution in R?, since otherwise 
the uniqueness will be violated. 


So far we have discussed results concerning the nonexistence of periodic solu- 
tions, or periodic trajectories, or limit cycles. Next, we look at the existence of limit 
cycles. 


Theorem 6.4.3. A closed orbit or limit cycle of (6.4.1) surrounds at least one equi- 
librium point of the system. In other words, if no equilibrium point of the system exists 
in a region, then there can be no periodic orbits in that region. 
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Let (0, 0) be the only equilibrium solution of (6.4.1). Moreover, suppose any so- 
lution of (6.4.1) that starts near the origin will spiral away from the origin. Since there 
are no equilibrium solutions, our first thought might be that all solutions of (6.4.1) 
have trajectories that spiral out to infinity. However, the next theorem, due to Poincaré 
and Bendixson, presents us a different scenario. It shows, under certain conditions, 
the existence of a limit cycle. Its proof requires high-level arguments, and we omit it. 


Theorem 6.4.4. (Poincaré-Bendixson) Suppose R is a closed bounded region of the 
plane enclosed by two simple curves j1, and [12. If R is free of equilibrium solutions 
of (6.4.1) and there is a trajectory C confined to R, then either C is a limit cycle, or 
it spirals toward a limit cycle. 


The main point of the theorem is that if we find one solution that exists for all t 
large enough (that is, we let ¢ go to infinity) and stays within a bounded region, then 
we have found either a periodic orbit or a solution that spirals toward a limit cycle; 
that is, in the long term, the behavior will be very close to a periodic function. We 
should take the theorem more as a qualitative statement rather than something to help 
us in computations. In practice, it is hard to find solutions and therefore hard to show 
rigorously that they exist at all times. Another caveat to consider the theorem is that 
it only works in two dimensions. In three dimensions and higher, there is simply too 
much room. 

As an application, we provide the following example. 


Example 6.13. 
x’ =y+x[1—x*-y7], y =—x+yf[1—2?- yy’. (6.4.3) 


It is clear that (0, 0) is the only equilibrium solution of (6.4.3). Let us pass to polar 
coordinates. Namely, 


x =rcos(@), y=rsin(@), where raxe+ ye. 
and r = r(t) and 6 = @(t) = tan~'(~). Thus 


d 2,2 d 4 
a 
or 

xx! + yy’ =rr’. 
A substitution of x’ and y’ yields 

r=rl— r’), 


)_ xy oxy _ 
== aiagde oa. 
x“ +y 
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FIGURE 6.9 


Limit cycle. 


For constants c and k, the solutions are given by 


1 
= S21) 6S 44.450. 
V1+ ce? 


For c = 0, we have that r = 0 and (x(f), y(t)) = (cos(t), — sin(f)) is a periodic 
solution with trajectory given by the unit circle in red (light gray in print version) 
in Fig. 6.9. For c > 0, we have 0 < r(t) < 1, and as ¢ increases, r 7 1, and the 
corresponding solution approaches the unit circle from inside of the circle in a spiral 
way as t — ov, as indicated in Fig. 6.9. For —1 <c <0, we have r(t) > 1, and as 
t increases, r \, 1, and the corresponding solution approaches the unit circle from 
outside of the circle in a spiral way as t > oo, as indicated in Fig. 6.9. Therefore 
the unit circle x2 + y? = 1, given parametrically by (x(t), y(t)) = (cos(f), — sin(t)) 
is a limit cycle for (6.4.3), and it is asymptotically stable. Note that (0, 0) is the only 
equilibrium solution inside the unit circle. As for the construction of the region R, we 
let 1 < & < 2, where 0 < ww; < 1 and | < 2 < on, and define the annulus region 


R={(x,y): mi <x? +y? =1 < py}. 


Clearly, R contains no equilibrium solution, and by Theorem 6.4.4, there is a periodic 
cycle in R. 


6.5 Lotka—Volterra competition model 


If two populations x; (t) and x2(t) were growing logistically and not affecting each 
other, their growth can be described by two uncoupled logistic equations 
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x} (1) =rixi(t)(1 — 2), 
x5 (t) =roxo(t)(1 — 2), 


x1(0) > 0, x2(0) > 0, 


where r;,i = 1,2, are the growth rates (birth-death), and K;,i = 1, 2, are positive 
constants. If the two populations were competing for the same resources, then the 
growth rate of each population is affected by the other. In that case the model becomes 


xi (t) =rixi()(1 — 22 — Aix2(0)), 
x4 (t) = roxa(t)(1 — 2 — Araxi (0), 


x1(0) > 0, x2(0) > 0, 


where A;,i = 1,2, are positive constants. To simplify the calculations, we convert 
the system by using non-dimensional variables by measuring x; in units of Ky, x2 in 
units of K2, and time in units of a We let 


xi (t) = Ki x(t), x12(t) = Kzy(t), and t= oe 
1 


By the chain rules, it follows that 


dx dxidt dx, 1 
ds dtds dtr, 


Ky 
or 
, (t) dx 
x =r,K\—. 
1 14] Is 


Substituting this back into the first equation of the model, we arrive at 
dx 
r,K, ae = r K,x(s)(1 —x(s)—- 41 K2y(s)), 


from which we get 


d 
7 = x(s)(1 — x(s) — Ar Koy(s)). 


as 
Similarly, we obtain 


d 
=ry(s)(1— y(s)—A2Kix(s)), 


where r = ae 
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Interchanging s with ¢ and letting 4; =A ,K2 and “2 = AK}, we arrive at the 
dimensionless Lotka—Volterra competition model 


x(t) =x0)(1-—x@ —wiy@), 
y(t) =ry(t)(1 — y(t) — we2x(t)), (6.5.1) 
x(0) = x9 > 0, y(O) = yo > 0. 


Next, we show that solutions of (6.5.1) are positive and remain bounded for all ¢ > 0. 


Proposition 6.1. [f x(t), y(t) is a solution pair of (6.5.1) with positive initial condi- 
tions xq and yo, respectively, then they are positive and bounded for all t > 0. 


Proof. Let x(t), y(t) be a solution of (6.5.1) with positive initial conditions xg and yo. 
Dividing the first equation of (6.5.1) by x(t) and the second equation by y(t), respec- 
tively, and integrating, we get the integral relations 


x(t) = tpel (1-x(s)—1y(s)) ds 


and 
y(t) = yoe” fo (1-y(s)-nas(s))as- 


We see that if the initial conditions are positive, then the components of the solution 
are positive. It is left to show that the solutions remain bounded for all t > 0. Since x 
and y are positive, we have that 


x(t)(1— x(t) — wiy@) <x@(1-x@) 


and 
ry(t)(1— y@ — pex(t)) <ry@(1- y@). 
It follows that 
x'(t) <x(@)(1—x@) and y'() <ry@(1—y@). 
From now on, we write x for x(t) and y for y(t). Consider the differential equation 
2 =201=2), 20) =20) =». 


Separating the variables and then integrating, we get [ wis = f dt. Using partial 
fractions on the left side integral, we obtain Ln| i | =t-+C. Taking the exponential 
on both sides, solving for z, and then applying the initial condition, we arrive at the 
unique solution 


xoe! 
z(t) = ——————— > l as t> om. 
1+ xo(e! — 1) 


Copyright Elsevier 2022 


ER 


188 


CHAPTER 6 Nonlinear systems 


Since z is positive and has a limit, we conclude that z is bounded for all t > 0. More- 
over, 


z2(t)<lastoo. 


From this discussion we arrive at 


s(t) <z@<1. 


Similar results can be obtained for y(t). This concludes the proof. 


Setting the right sides of (6.5.1) equal to zero, we obtain the equilibrium solutions 
Eo = (0,0), Ei = (0,1), Er = (1, 0), 
and 
£3, which comprises of the solutions (if they exist) of x + uwiy=1, waxt+y=1. 


Next, we use Theorem 6.2.1 to analyze the stability of the equilibrium solutions. The 
Jacobian matrix is 


_ (1-2x-pm1y [4x 
Ja.n=( -ruzy r= 2x—pox)) 


J(0,0) = ¢ ’) 


with eigenvalues A = 1, r, and hence by Theorem 6.2.1 and Remark 6.3 Eo is unstable 


or repeller. At £1, 
J(0, I= (' i 2 ) 
—ru2  —r 


with eigenvalues A = | — jz; and —r, and hence by Theorem 6.2.1 and Remark 6.3 
EF, is either a saddle or asymptotically stable. Similarly, at FE», 


i! HI 
ag ( 0 rd ) 


with eigenvalues A = —1 andr(1 — j12), and hence by Theorem 6.2.1 and Remark 6.3 
E> is either a saddle or asymptotically stable. For, E3 we solve the system 


For Eo = (0, 0), we have 


x+miy=1, woxt+y=l. 
After some calculations, we obtain 


1-1 1— p2 


E3= ; : 
1—pip2 1—pip2 
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Case: (a) My) <1, ke >1 Case: (b) 1 >1, be <1 
FIGURE 6.10 


No equilibrium points in the first quadrant. 


The stability of the equilibrium solution of E3 is important to biologists since it shows 
the coexistence of both species. We will analyze the stability by considering different 
cases that are based on the eigenvalues. 


Case (a): 4) < 1, 2 > 1. 

In this case the lines x + 4, y = 1 and 2x + y = | do not intersect in the first quad- 
rant, and it follows that £3 is not an equilibrium solution as depicted in Fig. 6.10. In 
addition, in Case (a), Ez is asymptotically stable, and E; is a saddle point. Since the 
interior of the first quadrant does not contain any equilibrium solution, it follows from 
Theorem 6.4.3 that there is no periodic solution in the first quadrant. Recall that by 
Theorem 6.4.3 a closed orbit or limit cycle surrounds at least one equilibrium point. 
Thus by Theorem 6.4.3 the omega limit set of any trajectory is the equilibrium solu- 
tion E>, and hence £3 is globally asymptotically stable; see Fig. 6.11. The biological 
meaning is that population x wins the competition. In other words, population y be- 
comes instinct. 


Case (b): 4, > 1, 2 < 1. 
In this case the roles of E; and E? are reversed, but still only one competitor survives. 
Next, we consider the cases where E3 is in the first quadrant, that is, £3 is an 
equilibrium solution. 
It turned out that E3 is an equilibrium solution in two cases. 


Case (c): 4 < 1, 42 < | and Case (d): 4; > 1, 2 > 1. 

Next, we make use of Theorem 6.4.2 (generalization of the Bendixson—Dulac the- 
orem) to study the possibilities of the existence of a periodic solution that sur- 
rounds £3. Let h(x, y) = x. Then / is a continuously differentiable function in 
G = {(x, y):x >0, y > O} with 


0,1 1 


ala —x—p1y)] — 
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Ey 


E9 
FIGURE 6.11 
Ep is globally asymptotically stable. 
and 
a, 1 : 
a ereau y pox)|=——. 
Thus 
Bie dy, i 1 r 
jglgyt (lx my) + Teel 5 wan) =-E +5), 


which is negative in G. Therefore there is no periodic solution in the first quadrant in 
both case (c) and case (d). 
Let (x*, y*) be a solution of x + wry = 1, wox + y = 1, that is, (x*, y*) = 


(tS hey Then 
—Hib2’ I-pip2’* 


J (x* y*)= L209 piy” Spx 
, —rp2y* r(1 — 2y* — pox") 
ae 
= 7 
rey" r(l — 2y" — wim) 
_ _x* —pix* 
TST JAP): 
and tra(J (x*, y*)) = —x* —ry* <0 for x*, y* > 0 implies that the sum of the eigen- 


values is negative. Moreover, 


det(J(x*, y*)) =rx*y* — ryuypox*y* = rx*y*(1 — wip). 


det(J(x*, y*) — AL) =A? — tra(J (x*, y*))A + det(J (x*, y*)), 
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Case(c): fy <1, wb <1 Case(d): fy >1, b> 1 


Ey 
Es <_— 
je 
Eo E> 
(e): <1, <1, 1l-Mim>0 (f): Mi > 1, be > 1,1-Mibe <0 
FIGURE 6.12 


Coexistence. 


we have that 
M+ (x* + ry*)a + rx*y*(1 — 12) =0. 


It follows that the eigenvalues are given by 


—a* —ry* t/t ryt)? — 4raty* — wa) 
5 


A= 


So £3 is asymptotically stable if 1 — 142 > 0 and a saddle if 1 — wip2 < 0. 
Fig. 6.12(d) and (f). 

If 44142 = 1, then the two lines are parallel or coincident. If coincident, then there 
is a line of equilibrium solutions, and if parallel, then cases (a) and (b) apply. In 
case (c), 1 — “1 > O and | — 2 > 0, so EF; and E2 are saddle unstable points. Since 
[142 < 1, E3 1s an attractor, that is, all solutions tend to £3. In that case the two 
populations coexist. See Fig. 6.12(d). 


Copyright Elsevier 2022 


a 


192 CHAPTER 6 Nonlinear systems 


In case (d), 4; — 1 > 0 and w2 — 1 > 0, and hence E} and E>» are asymptotically 
stable. Also, in case (d) 41/42 > 1, and so E3 is a saddle point. See Fig. 6.12(f). Here 
the initial conditions determine the winner. 


6.6 Bifurcation in planar systems 
We consider the two-dimensional autonomous system 
x! = P(x, y, mu), y= O(x, y, H) (6.6.1) 


depending upon a real parameter jz. We assume that P and Q are continuous in all 
arguments on some subset of R*. As jz changes values or signs, the behavior of solu- 
tions changes and may result in bifurcation points. For example, as we move across 
a particular equilibrium solution, the stability may change from stable to unstable, 
and vice versa. We begin by considering the following example. 


Example 6.14. Consider the two-dimensional linear system 
x =xt+py, =x-y 


for parameter jz. The matrix 


has the eigenvalues 


=+t/14+ yp. 
If « > —1, then the eigenvalues are real with opposite signs, and therefore the ori- 


gin (0, 0) is a saddle point (unstable). For the particular value 4. = —1, the system 
becomes 


/ iE 
x =x-y, Yax-y 


and results in the whole line y = x of fixed points. If 4. < —1, then the eigenvalues 
are purely imaginary, and the origin (0, 0) is a center (stable). As 44 > —1 decreases 


to wz < —1, the nature of the solution changes at 4. = —1; as a result, the equilibrium 
solution (0,0) changes from an unstable saddle to a stable center as jz passes the 
critical value —1. Thus we have a bifurcation at ~ = —1. 


Example 6.15. Consider the planar autonomous system 
x= yx +y—y), y =x-yQ*+y"— 4H). 


It is clear that (0, 0) is the only equilibrium point. We rewrite the system in the form 
(Y-6 DOCER 
y 1 ousy\y ~yr ty} 
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The eigenvalues of 


are +i. 


(1) If ~ <0, then the trajectories spiral toward the origin, and the origin is asymptot- 
ically stable by Theorem 6.2.1. 

(2) If > O, then the origin is unstable for the nonlinear system. 

(3) If u = 0, then Theorem 6.2.1 says nothing about the stability or instability about 
the origin of the nonlinear system. 


Next we examine in more detail the trajectories of the system by using polar 
coordinates as we did in Example 6.8. By doing so we arrive at 


r=r(u- r’) and 6’=1. (6.6.2) 


Separating the variables and using partial fractions we arrive at 


d 
/ fi =t+k for some constant k. 
rr — JD + JA) 


This leads to the solution 


ve 

J 1+ ce72ut 

Similarly, if we choose 6(0) = 0, then we have @(t) = ¢. 
Assume that jz > 0 and consider the following three cases. 


r(t)= (6.6.3) 


(3a) When c = 0, we have from (6.6.3) r(t) = ./, which represents a periodic solu- 
tion with radius //j. 

(3b) If c < 0, then (6.6.3) represents an orbit or trajectory that spirals counterclock- 
wise toward the circle r(t) = ,/u from the outside. 

(3c) If c > 0, then (6.6.3) represents an orbit or trajectory that spirals counterclock- 
wise toward the circle r(t) = ,/ from the inside. 


Let 0 < 41 < “ < 2 and define the annulus region 
R={(x,y): mM <x? +y? < py}. 


Clearly, R contains no equilibrium solution, and then cases (3a)—(3c) prove that the 
circle given by r?(t) = w or x* + y* = is a stable limit cycle and the origin is 
unstable. 


Next, we examine the stability of the origin when pz = 0. 
In this case (6.6.2) gives 
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stable unstable 


FIGURE 6.13 


Bifurcation diagram for Example 6.15. 


which has the solution 


1 
r(t) = ——— 
V2t+K 
for a suitable constant K. Clearly, r(t) — 0 as t > ov, and hence the zero solution 
(or the origin) is asymptotically stable (spirally stable). 
Finally, for u <0, from (6.6.2) we have 


r=r(r° +l’) and 6’ =1, 


where /* = — jz > 0. Separating the variables and using partial fractions, we arrive at 
dr 
——,~ = —dt for some constant k. 
r(r2 +1?) 


This leads to the solution 


2 
cl2e72! t 


r(t)= for some constant c. 
1 [71 


cl?e? 
Clearly, r(t) — 0, as t > oo, and hence the zero solution (or the origin) is asymp- 
totically stable (spirally stable). In conclusion, for pz < 0, the origin (0, 0) is stable, 
and for 4 > 0, (0,0) is unstable, and r = ,/y is stable. Thus as jz passes through the 
critical value jz = 0 from negative to positive, the origin changes from stable spiral 
to unstable spiral, and there appears a new limit cycle that is a periodic solution. This 
type of bifurcation is common and known as Hopf bifurcation. 
The bifurcation diagram is shown in Fig. 6.13. 


The next theorem provides a necessary condition for the existence of Hopf bifur- 
cation. The proof is complicated, and hence we omit it. 


Theorem 6.6.1. Consider the two-dimensional autonomous system 


t= PO.7o: ¥ HOG.e) (6.6.4) 
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depending upon a real parameter jt, where P and Q are differentiable in the neigh- 
borhood of (0, 0,0). Assume that for small pu, 


P(0,0, w) = Q(0, 0, w) =0. (6.6.5) 


Let the Jacobian 


_ (P(0,0,0)  P,(0,0,0)\ (0 —w 
J(0, 0,0) = ar 0,0) Qy(0,0, 3) = (° 0 ) for some w4#0. (6.6.6) 
Let 
1 
a= ieee + Oxxy ale Pryy + Oyyy) 
1 
= Tey (Pav (Pax a Pyy) ~~ Oxy(Qxx =P Oyy) _ Prx Oxx ae Pyy Qyy) (6.6.7) 


evaluated at (0,0, 0) with a £ 0. Suppose that 
a(Pux + Quy) > 0. (6.6.8) 


Then for sufficiently small jz < 0, there is a unique periodic solution with amplitude 
A(t) such that 


A 
m —e=c>0. 


i 
ee NATTA 

If 
a Pus + Dis) <0, (6.6.9) 


then the periodic solution exists for 4 > 0. The stability of the periodic solution is 
determined by the sign of 


Pux + Quy (6.6.10) 


and is the opposite of the stability of the zero solution in the range of 4 where the 
periodic solution exists. 


Example 6.16. As an application of Theorem 6.6.1, we consider the system given in 
Example 6.14. It readily follows that the Jacobian 


_fmu —-l\_/0 -1 
J(0, 0,0) = ( |)= ¢ 0 ) 
Thus condition (6.6.6) is satisfied with w = 1. After simple calculations, it follows 
that (6.6.7) evaluated at (0, 0, 0) implies that a = —1. Moreover, 
a(Pux + Oa) =-11+4+1) <0. 


Thus by Theorem 6.6.1, the system possesses a periodic solution for 4 > O that is 
stable (spirally stable) since the origin is unstable in the region where ju is positive. 
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a2 


. 
. 


FIGURE 6.14 


Buckling beam. 


We end this section with an application to Euler’s buckling beam. 


Example 6.17. (Euler’s buckling beam) One of the most famous applications to bifur- 
cations is the so-called Euler’s buckling beam. Consider different scenarios of beams 
in Fig. 6.14, where excessive pressure is applied to the beam. The beam can support a 
small force or pressure, but as the force is increased, the beam will go through a qual- 
itative change in its vertical standing position. At one point, as we keep increasing 
the force, the beam position will get compromised and results in a so-called buck- 
ling, that is, there will be a critical value at which if the pressure is increased beyond 
it, then the beam will buckle. Fig. 6.14 provides different situations for such buck- 
ling beams along with supported ends. As for modeling, suppose we have a beam 
of length one unit and the beam is placed along the horizontal axis with one end 
supported by a fixed wall and a force F > 0 applied along its axis. Let 5 > 0 be the 
viscous damping, and let K > 0 be the stiffness. The small deflection of the beam 
is denoted by u(x,t), where x denotes the horizontal axes. After transforming the 
model from a partial differential equation to a second-order differential equation, it 
was shown in [27] that the amplitude wu in variable time ¢ satisfies the second-order 
differential equation 


1 
u(t) + bu! (t) — 2° (F — 27)u(t) + 5 Krtw'(t) =0. (6.6.11) 
To better study the differential equation, we put it in the system form 


/ 
Xx =Yy, 


; (6.6.12) 
y’ =n? (F — 2?)x — by — 5Kn*x3, 


where the force F is the only parameter. The system has three equilibrium solutions 
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0.0 2(F — 1?) 0 d 2(F — 1?) 0 
(0,0), ¢ a ), and (— a an ). 


Note that the equilibrium solutions 


/2(F — 22) /2(F — 22) 
( a and (— eo) 


are only valid for F > 7. 
Now 


0 1 
| aA ah 25 


with eigenvalues 


—5 + /82 4+ 402(F — 17) 
: , 


A= 


and, as a consequence, (0, 0) is stable if F < x” and unstable if F > 7. The physical 
implication is that the beam will buckle if F > 2. 


2(F—12) 


Rar» 0) for F > 27. We translate 


Now we consider the equilibrium solution ( 
it to the origin with transformation 


2(F — 2) 
xXyp=xX- a a » 1 =0 


and arrive at the linearized matrix 


0 1 
TONS | pation aay 


with eigenvalues 


_ 6 £/8? — 8n2(F — 0”) 
= ; 


Xr 


It follows that (0, 0) is stable if F > zr and that the equilibrium solution ( ro *) 0) 


is stable for F > 27. The physical implication is that the beam will buckle if F > 2. 


Similarly, we can easily show that the equilibrium solution (— 26") 0) is 


also stable for F > 7. Thus we have a pitchfork bifurcation at F = 27. The bifurca- 
tion diagram in Fig. 6.15 shows that bending is symmetric and can take place in the 
negative direction as well. 
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stable 


— [(R—n2) 
io Kn2 


stable stable z unstable 


FIGURE 6.15 


Bifurcation diagram for uv = + 


6.7 Manifolds and Hartman—Grobman theorem 


In the study of dynamical systems and differential equations, the stable manifold 
theorem is an important result about the structure of the set of orbits approaching a 
given hyperbolic fixed point. Stable manifolds are directly related to the important 
Hartman—Grobman theorem, which states that the flow generated by a smooth vector 
field in a neighborhood of a hyperbolic equilibrium point is topologically conjugate 
with the flow generated by its linearization. Hartman’s counterexample shows that, 
in general, the conjugacy cannot be taken to be C!. However, the stable manifold 
theorem tells us that there are important structures for the two flows that can be 
matched up by smooth changes of variables. 

Let f : ECR” — R" be C! and consider the autonomous nonlinear differential 
equation 


x’ = f(x). (6.7.1) 


Definition 6.7.1. An equilibrium point x9 of (6.7.1) is called hyperbolic if none of the 
eigenvalues of the matrix Df (xo) has a zero real part, where throughout this section, 
we adopt the notation 


Df (xo) = J (x0). 
For example, the system 
/ / 


x’=y, y=—x—x3-3y 


has (0, 0) as its only equilibrium solution. The linearization at (0, 0) is 


Df(0,0) = ee Ly 
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which has the eigenvalues 


—2+ 
a tS 
2 


Thus (0, 0) is a hyperbolic equilibrium solution since none of the eigenvalues has the 
zero real part. 

Our aim is to show that the local behavior of the nonlinear system (6.7.1) near 
a hyperbolic equilibrium point xo is qualitatively determined by the behavior of the 
linear system 


x’ = Ax, (6.7.2) 


where the matrix A = Df (xo). Now we define the flow or trajectory of (6.7.1) that 
suits our notations for this section. Denote the maximal interval of existence (a, B) 
of the solution ¢(t, xo) of the IVP 


x’ = f(x), x0) =x* (6.7.3) 


by /(x*) since a or 6 usually depend on x*. If x* € E and t € [(x*), then the set of 
mappings ¢; defined by 


r(x") = b(t, x*) 
is called the flow of (6.7.1). We define the set Q CR x E as 
Q={(t,x*)ERx E: tel (x*)}. 


We leave it an exercise to show that the set Q is an open subset of R x E and dé 
c!(Q). 


Theorem 6.7.1. Let E CR” be open with f € C!(E), and let ¢; : E > E be the 
flow of (6.7.1) defined for allt € R. 

(i) The set S C E is said to be invariant with respect to the flow ¢; if ¢,(S) C S for 
allt ER. 


(ti) The set E is said to be positively (or negatively) invariant with respect to the flow 
or if &:(S) C S for allt > 0 (ort <0). 


We furnish the following example. 


Example 6.18. Consider the nonlinear system of differential equations 


gl (" +32) 
ip 
x(0) = (5) = x*, 


with 
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Now ca = —X» has the solution x. = be~'. Substituting this solution of x2 into the 
first differential equation and using the variation of parameters formula, we arrive at 
x} =ae’+ zb7(e! —e~*'), Thus 


put) (20+ Ee), 
be 
Next, we show that the set 
S = {x € R*: x1 = —x3./3} 
is invariant under the flow ¢,. Let x* € S. Then a = —b? /3, and it follows that 
1,2 ,—2t 
—<zb 
Giry=(~3" © Jes. 
be 


Therefore ¢;(S) C S for all t € R. We will see later that the set S will be called the 
stable manifold for system (6.7.1). 


We are ready to formally define stable and unstable manifolds. 

Consider the linear system given by (6.7.2) and suppose the eigenvalues of A 
and their corresponding generalized eigenvectors are A; =a; +iB; andk; +i d; for 
j=1,2,...,n. Let those vectors be the columns of the matrix P. Then P-'AP=J, 
where J is the Jordan form of A. Then the sets 


E* := Span{k;,dj:a; <0}, 
E" := Span{kj,dj :aj; > O}, 


E° := Span{k;, dj; :aj; =0} 
are the stable, unstable, and center subspaces for system (6.7.2). 


Definition 6.7.2. Suppose that x9 is a hyperbolic equilibrium point of (6.7.1). 
(i) The stable manifold of xo is the set 


W* (xo) = {x* € E: lim ¢,(x*) = xo}. 
ttoo 
(ii) The unstable manifold of xo is the set 


W" (xo) ={x" € E: fim be O") = Xo}. 


We have the following example. 
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Example 6.19. Consider the system given in Example 6.18. Then the eigenvalues of 
A= Df (0,0) are A = +1. If 1 = 1, then its corresponding eigenvector is given by 
v; = (1, 0)". Similarly, v2 = (0, 1)" is the corresponding eigenvector for 4 = —1. 
Thus 


E“ =((x,y)€R’:y=0} 
and 
E* = {(x, y)€ R*:x =0}. 
Now lim; too 1 (x*) = xo if and only if a+ a /3 =0. Thus the stable manifold is 


W* (xo) = {x* € R? :a = —b?/3}. 


Similarly, lim; )—oo ¢;(x*) = (0, 0) if and only if b = 0. Thus the unstable manifold 
is 


W“ (0, 0) = {x* ER? :b = 0}. 


6.7.1 The stable manifold theorem 


The stable manifold theorem that we are about to state and give a sketch of its proof 
states that (6.7.1) has stable and unstable manifolds W* and W“ that are tangent at 
Xo to the stable and unstable subspaces E* and E“ of the linearized system (6.7.2), 
where xg is a hyperbolic equilibrium solution of (6.7.1). Furthermore, W* and W“ 
are of the same dimensions as E* and E“. Besides, W* and W” are positively and 
negatively invariant under ¢;, respectively, and satisfy 


lim $;(x*) = xo forall x* € W*, 
ttoo 


lim $;(x*) = xo forall x* ¢ W”. 
t)—oo 
We furnish the following example that should serve as warm up. 


Example 6.20. Let g € C'(E), where E C R? is an open set containing (0, 0). Con- 
sider the nonlinear system 


x’ =—-x, 

y' =y+s), 
where we assume that g(0) := g(0, 0) = 0 and that the function g may contain linear 
terms. The only equilibrium solution of the system is the origin and the Jacobian is 


—-1 0O 
DF0.0=( 6) 1): 
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Then the eigenvalues of A = Df (0, 0) are A = +1, and the zero equilibrium is hyper- 
bolic. If A = 1, then its corresponding eigenvector is given by v; = (0, 1)’. Similarly, 
v2 = (2, —g’(0))" is the corresponding eigenvector for 4 = —1. Thus 


E" ={(x, y)€R?:x =0} 
and 
1 
E* ={(x,y) €R’:y=—58'(O)x}. 


To find the stable and unstable manifolds, we directly solve the system. Assume an 
initial point x(0) = a, y(0) = b for a,b ER. The first equation in the system has the 


solution 
po ot 
x(t)=ae-. 


Substituting x back into the second equation and using the variation of parameters 
formula, we arrive at 


t 
y(t) = be! + ef e *g(ae *)ds. 
0 


Making the substitution u = e~*, we arrive at the flow 


xO) a 
c= ; 
be’ +e! fs g(au)du 


If c= (a,b) € R? is in the unstable manifold W“ (0, 0), then lim;) —o0 ¢:(c) > 0. 
Then from the first component of ¢; it follows that lim, | — ae—' = 0 if and only if 
a = 0. Substituting a = 0 into the second component of ¢; and taking the limit, that 
is, lims}o0 (be! +e! a g(0)ds) = lim;|—oo be’ = 0 (since g(0) = 0), it follows that 


W“ (0, 0) = {(x, y) € R*: x = 0}. 
Similarly, if c = (a, b)’ € R? is in the stable manifold W* (0, 0), then lim; t 00 Ot (C) > 


0. Then from the first component of ¢; it follows that lim;too ae—' =0 for any a. 
From the second component of ¢; we have 


t 
lim ef C +e / g(O)ds) =; (6.7.4) 
ttoo -t 


e 


To that effect, we claim that 


1 
b= -| g(au)du. 
0 
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To see that this satisfies (6.7.4), we first notice that 


—t 


1 e 1 
/ e(auydu = | e(audu + | g(au)du. 
0 0 et 
Then it follows 


1 1 et 
lim (| g(au)du -| g(au)du) = — lim é| g(au)du. 
ttoo e-t 0 ttoo 0 


We must show that the term e’ {, g(au)du is small for all t > T for sufficiently 
large T. Since g is continuous with g(0) = 0, given e > 0, there exists 6 > 0 such that 
|g(au)| < ¢ for |au| < 5. Moreover, as 0 < u < e~", we have |au| = |a||u| < jale~’. 
Thus we can choose T > 0 sufficiently large so that |ale~’ < 5 for t > T. Therefore 
le! to g(au)du| < e. As this can be done for any ¢ > 0, we conclude that (6.7.4) 
holds. It follows that the stable manifold is 


1 
W* (0,0) = {(x, y@@)) € R*: yx) = -{ g(xu)du}. 
0 
Note that we could easily use L’Hospital’s rule on lim; 4o0 et a g(xu)du to show 
that (6.7.4) holds. Next, we show that W* is tangent to E°: 


d 


y 1 
Fy lk=0 = — i g'(xu)udu| 4 


Making the substitution v = xu, this expression becomes 


d 
Flo=-3 f g(v)udv]_, 263 
Using L’Hospital’s rule, we find the slope at the origin to be 
a ‘(v)vdv|,-9 =~ Ii yal, som lim £O* __1 @) 
= v)udv me ee! v)vdv = — lim = : 
e 2 0 . x30 2x a 


Thus W’ is tangent to E° at the origin, and, moreover, W* € C!. 


Let g(x) = xe* in Example 6.20. Then g(0) = 0 and g € C!. Furthermore, 


s 2 1 / 2 1 
E* ={(x,y)ER ‘y=—Za Oxr}={@, YER ys— ah, 
and 


1 1 
1. 1 
y(x)= -| g(xu)du = xue"“du = —e* + —e* — —. 
0 0 x 


x 
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Substitute the Maclaurin series for e* into the last expression and simplify to get 


Sige 4 ) 
a: a 3 


Thus 


W'(0,0) = [(x. ¥@)) ER?: y(x)= +0 4s = i “I. 


In Example 6.20, we were able to compute the solutions to find W* and W. This 
is not the case for most nonlinear systems. The next theorem affirms the existence of 
such manifolds in the neighborhoods of hyperbolic equilibrium solution, regardless 
of whether solutions can be found or not. We have seen that the stable manifold of 
a hyperbolic critical point is the collection of all states that asymptotically approach 
that fixed point as time goes to infinity. Knowing the stable and unstable manifolds of 
a fixed point can be useful for simple purposes, for example, for knowing which initial 
conditions of a system of ordinary differential equations lead to which asymptotic 
behavior. It is also very useful for spotting “exotic” behavior in dynamical systems. 

As mentioned before, if the equilibrium solution is not the origin, then we use 
transformation so that it coincides with the origin. Next, we define the differentiabil- 
ity of manifolds. 


Definition 6.7.3. (Homeomorphism) Let K; and K2 be two subsets of a metric 
space X. Then K, and K2 are said to be homeomorphic if there is a continuous 
one-to-one map g : K; — K2 such that g~! is also continuous. 

Such two sets are called homeomorphic or topologically equivalent if there is 
a homeomorphism of K; onto K2. 


Definition 6.7.4. (Differentiable manifold) An n-dimensional differentiable mani- 
fold M is a connected metric space with an open covering M = Ug Uy, such that 


(1) for all a, Uy is homeomorphic to the open unit ball B = {x € R” : |x| < 1} in R” 
centered at the origin, that is, for all a, there exists a homeomorphism gy : Uy > B 
of U, onto B, and 

(2) if Uy NUg AG and gy : Uy > B, gg : Ug > B are homeomorphisms, then 
8a(Uw M Ug) and gp(Uw M Ug) are subsets of IR”, the map 


8 = 8008, |: 86(UaN UB) > ga(UaM Up) 
is differentiable (or of class C”), and for all x € gg (Uw M Ug), the Jacobian determi- 
nant is not zero, that is, det 28 #0. 


For complete proof of the next theorem, we refer to [36]. 


Theorem 6.7.2. Suppose f (0) =0 and let E CR” be an open subset containing the 
origin with f € C!(E). Let ¢; : E — E be the flow of (6.7.1) defined for all t € R. 
Let 


x’ = Ax := Df (0)x. (6.7.5) 
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Suppose the linearized matrix Df (O) has k eigenvalues with negative real parts and 
n — k eigenvalues with positive real parts. Then there exists a k-dimensional differ- 
entiable manifold W* that is tangent to the stable subspace E* of (6.7.5), and there 
exists an (n — k)-dimensional differentiable manifold W" that is tangent to the un- 
stable space E" of the linearized system (6.7.5). Moreover, 


lim ¢;(p) =0 forany pe W’, 
ttoo 


and 
lim ¢;(p)=0 forany pew". 
t|—oo 


Proof. (We only provide a sketch of the proof) This sketch of the proof is geared 
toward giving guidelines on how to find the stable and unstable manifolds. 
Since f € C!(E) and f (0) = 0, we may write system (6.7.1) as 


x’ =Ax+ F(x), (6.7.6) 


where A = Df(0) and F(x) = f(x) — Ax with F € C!(E), F(O) = 0 and 
DF (QO) = 0. There is an invertible n x n matrix C such that 


et ge fP -O 
pectace(® °), 


where the k x k matrix P has the eigenvalues 4;, i = 1,2,...,k, each with neg- 
ative real part, and the (n — k) x (n — k) matrix Q has the eigenvalues A;, i = 
k+1,k+2,...,n, each with a positive real part. Make the change of variables 
y =C7!x. Then x’ = Ax + F(x) becomes Cy’ = ACy + F(Cy). Multiplying both 
sides from the left by C~! gives y’ = C7'ACy+C7! F(Cy). Set G(y) = C7! F(Cy) 
to arrive at 


y= (5 )o +6(). (6.7.7) 


Since each step we have made is reversible, solving system (6.7.7) is equivalent to 
solving the original system (6.7.6). Next, we labor to find stable and unstable mani- 


folds. Define 
_ eft O _ 0 O 
U(t)= ( 0 0 and V(t)= 0 ea)? 


& 5) 
a 2) a7 Have: 


For t € Randa € R”, define the integral equation 


so that 


t 


u(t,a) =U(t)a +f U(t — s)G(u(s, a))ds 
0 
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- _ V(t —s)G(u(s, a))ds. (6.7.8) 
t 


Perko showed the integral equation (6.7.8) satisfies (6.7.7) and jim u(t,a) = 0. De- 
=7:00. 


fine the iterative scheme for computing the solution: 


u(t,a)=0 


t 
uktD eg, a) =U(t)a +f U(t— Gus, a))ds 
0 


= i. Vit —s)G(u™(s, a))ds. 
t 


Next, we give some insight on why this integral equation given by (6.7.8) is chosen. 
In general, using the variation of parameters formula, the solution of (6.7.7) is 


eft 0 t eP(t-s) 0 
u(t,a) = ( a. ea a+ r 20lt-s) G(u(s,a))ds. 


Keep in mind that the goal is to remove the parts that blow up as t > oo. Thus we 
try to separate convergent and non-convergent parts from the above integral equation. 
Below we explain how this is done: 


u(t,a) = @ a a +f es re G(u(s,a))ds 
a se at ae [ ("," 4 G(u(s,a))ds 
[ ( eQtt— i) G(u(s, a))ds 

c se ‘( oye [ oa ; G(u(s,a))ds 
Cae 


[oe 
-{ i ot- 5 G(u(s,a))ds (remove terms that blow up to get) 
e 


+ 


+ 


G(u(s, a))ds 
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_(e" 0 (Pits) 9 

= ( 0 ) af ( 0 ) G(u(s, a))ds 
co /9 0 

=) ¢ cs) G(u(s, a))ds 


t 


=U(t)a +f U(t —s)G(u(s, a))ds — i V(t —s)G(u(s,a))ds. 
0 t 


It is evident that the last n — k components of a do not enter the computation, and so 
we take them to be zero. As a consequence, let u(t, a) be given by (6.7.8), and let us 
examine what that implies for the initial conditions u(0, a). First, we notice that 


uj(0,a)=aj;, j=1,2,...,k, 


uj 0.0) =—([ V(-s)G(u(s,a))ds) |, PERG uh, 


Hence the last n — k components of the initial conditions satisfy 
aj=Wj(ai,...dx) = uj(O,a1,...,ax,0...,0), F=k+1,...,n. 


Finally, the stable manifold W* (0) is defined by 


= (is ae a pS J=k+1,...,n}. 


Here is the iterative scheme for calculating an approximation to W*: 


(1) Calculate the approximate solution u(t, a). 
(2) For each j =k +1,...,n, the function wj(a),..., ax) is given by the jth com- 
ponent of u”) (0, a). 


To find the unstable manifold W“, do the same by replacing ¢ by —t, that is, 
y' =—By—-G(y). 


Then the stable manifold for this system will be the unstable manifold for (6.7.7). 
During the process, we must replace the vector y by the vector (yx41,---; Yn, V1, 
.., yk) to determine the (n — k)-dimensional manifold W” by the above process. 


We end this section with the following popular example. 


Example 6.21. Consider the planar nonlinear system 


ee 2 
XxX} = —X1 — X79, 
! 


y =xp +x2 


with the only equilibrium solution (0, 0). Then 
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A=Df(0)= ie i 


The eigenvalues of A are A = 1, —1 with corresponding eigenvectors (1) and ( ) ; 


respectively. Thus the matrix C is given by C = ¢ : 


-1 0 a 
a=B=(% i roo=am=(-2), 
_fet 0 _(0 0 


Since n = 2 and k = 1, the last components n — k of the n vector a are zero. So we 


take a = « 


u(t, a), and uw?) (t, a) and use u®) (t, a) to approximate the function yz describing 
the stable manifold W* : x2 = W2(x1). Define the iterate of the function u(t, a) using 


; — G u s,a 


=f (gen) oe onde 
t 
eon (°). 


uw (t,a)=Ua= ey ; 


-t t —(t—s) 
va =(% a+ [ ( ; 3 Gus, a))ds 
_ 0 ets) G(u\’(s, a))ds 
t 


) It follows that 


and 


) Our goal is to find the first three successive approximations u(t, a), 


where 
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-t tf o-(t-s) 
u(t, a)= (@ ;) a -{ ( 0 ; ) Gu(s, a))ds 
© (0 0 (2) 
— 0 els) G(u’(s,a))ds 
t 
2 ig t oF) 28 gt 0° 0 
=( 0 )-f ( ds — ; el) e~25 2 ds 


_ — + ae" - oe) 


—te Mat 
If we approximate u(t, a) by u®(t, a), then 


aCe oo + (ew = a) iS ae ) . 


je at u2(t, ay, 0) 
and 
wi(a,) = 44 (0, 41,0), Yo(ay) = u2(0, ay, 0) 


are approximated by 


1 5 
Wilai)=a1, W2(ai) = —341- 


Thus the stable manifold is approximated by 


1 
WS ={(y1, 92) ER? : 2 = — 3911. 


However, since the matrix C = / for this example, the x and y spaces are the same. 
It follows that the stable manifold is given by 


1 
w* = {(x1, x2) eR? x= — 347}. 


The unstable manifold W” can be found by applying the same procedure to the 
system with t — —tf and x, and x2 interchanged. Thus the stable manifold for the 
resulting system will be the unstable manifold for the original system. With this in 
mind, we arrive at the unstable manifold 


I 
W" = {(x1, 42) ER? 2x) = = 334). 


Remark 6.5. We used u®)(t, a) to approximate u(t, a), and so 
—t 1 /,—4t —ty),4 —t 
efajtal(e "—e')a e "ay 
u(t,a) ( - hes 1) x ees 
—2t —2t 
—7e ay —3e ay 
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M# 


ES 


MS 
FIGURE 6.16 
Local approximations of M* and M" of Example 6.21. 
when |a| = |(a;, 0)" | is small, or when a, is small. Thus the stable manifold can be 


approximated by 


w2(a1) = -(f V(-s)G(u(s, a))ds), 


Ae) 0 _17,-45 _ ,-ty),4 
--(f & >) ( 5 (€ : Jay ds), 
0 € eazy 
oa 1 
= -| ee Satds = 341. 
0 
Fig. 6.16 shows the stable and unstable manifolds in the neighborhood of (0, 0). 


6.7.2 Global manifolds 


The stable and unstable manifolds of Section 6.7.1 are local since they are defined 
in a small neighborhood of the origin. For that reason, they are referred to as the 
local stable and unstable manifolds at the origin. In this section, we define the global 
manifolds around the origin. 


Definition 6.7.5. Let ¢; be the flow of (6.7.1). The global stable and unstable mani- 
folds of (6.7.1) at the origin are defined by 


G* (0) = Ur<o¢:(W") 
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and 
G"(0) = Ursobr (W*), 
respectively. 


The global stable and unstable manifolds are unique and invariant with respect to 
the flow. Furthermore, for all x € G*(0), lim;_,o5 ¢; (x) = 0, and for all x € G“(0), 
lim,-s —90 G(x) = 0. 

For the next theorem, we define a neighborhood around zero. Let 6 > 0. Define 
the neighborhood of the origin by 


N3(0) = {x ER": ||x]| <5}. 


Theorem 6.7.3. Assume that the hypotheses of Theorem 6.7.2 hold. Suppose the 
linearized matrix Df (0) has k eigenvalues with negative real parts and n — k eigen- 
values with positive real parts. Set 


Re(a;) < —a <0< B < Re(ayn) 


for j=1,...,kandm=k+1,...,n. 
Then, given € > 0, there exists > 0 such that if p € Ns(0)N W*, then 


lf:(p)| <ee 


for all t => 0. Ina similar fashion, if p € Ns(0) NW", then 


lo:(p)| < ee! 
for allt <0. 


Theorem 6.7.3 states that if solutions start in the stable manifold W*, then they 
approach the origin exponentially. This is displayed in Example 6.19. 

The center manifold theorem gives a detailed description of the dynamic of (6.7.1) 
in a neighborhood of a hyperbolic equilibrium once the center manifold W° is deter- 
mined. 


6.7.3 Center manifold 


Theorem 6.7.4. Suppose f (0) =0 and let E CR” be an open subset containing the 
origin with f ¢ C!(E). Let ¢; : E > E be the flow of (6.7.1) defined for all t € R. 
Let 


x’ = Ax := Df (0)x. (6.7.9) 


Suppose the linearized matrix Df (0) has k eigenvalues with negative real parts, 
j eigenvalues with positive real parts, and m =n — k — j eigenvalues with zero 
real parts. Then there exists an m-dimensional differentiable manifold W (0) that is 
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tangent to the center subspace E* of (6.7.9), a j-dimensional differentiable manifold 
W" (0) that is tangent to the unstable space E“ of the linearized system (6.7.9), and 
an m-dimensional differentiable manifold W° that is tangent to the center space E° 
of the linearized system (6.7.9). Moreover, 


lim ¢;(p) =0 forany pe W*, 
ttoo 


lim ¢;(p)=0 forany pew", 
t{)—oo 


lim ¢;(p)=0 forany pew’. 
t)—oo 


In other words, the manifolds W*, W“, and W° are invariant under the flow ¢; of 
(6.7.1). 


Example 6.22. Consider the planar nonlinear system 


with the only equilibrium solution (0, 0). Linearization around the equilibrium solu- 


tion gives 
0 0 
A= vro=(5 *) 


The eigenvalues of A are A = 0, —1 with corresponding eigenvectors i) and @ 


Thus the stable subspace is E* = {(x1, x2) € R2:x,= O}, and the center subspace is 
E°={(x1,x2) € Re:m= O}. For constants c; and c2, the system has the solution 


cl = 
nO=——, Oo. 
1—cit 


Note that if c; = 0, then x; = 0. Moreover, to get a better understanding of the dy- 
namics of the solution, we eliminate ¢ from both equations and arrive at the following 
relation between x; and x2: 
-A4+2 
xX2=cQe “1 #1 


Since x; = 0 for c; = 0, we have that the plane curves 


~tayd 
ce 1 1 for xy <0, 


0) for x; =0 


x2 = W(x], C1,¢2) = (6.7.10) 
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X2 


w* (0) 


w*(0) 


x1 


FIGURE 6.17 


Center manifold. 


satisfy 


ow 
W(0,c1,c2) =0, —(0,c1,c2)=0. 
Ox] 


Now c; < 0 if and only if x; < 0 by x(t) = = 7 for all ¢ = 0. It follows that when 


x, <0 is sufficiently small, (6.7.10) is a local center manifold that is tangent to E° 
at the origin. However, since (6.7.10) holds for any c; < 0 and cz, there are infinitely 
many center manifolds, and all have the same orientations as seen in Fig. 6.17. 


6.7.4 Center manifold and reduced systems 


Let E C R” contain the origin, and let f : E > R” be C*. Consider the autonomous 
nonlinear differential equation 


x’ = f(x). (6.7.11) 
Since f € C!(E) and f (0) = 0, we may write system (6.7.11) as 
x’ = Ax + F(x), (6.7.12) 


where A = Df (0) and F(x) = f(x) — Ax with F € C!(E), F(O) = 0, and 
DF (0) = 0. There is ann x n invertible matrix C such that 


ann FP SD 
c ac=(6 ae 
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where the k x k matrix P has eigenvalues A;,i = 1, 2,...,k, each with zero real part, 
and the (n — k) x (n — k) matrix Q has the eigenvalues 4;,i =k+1,k+2,...,n, 
each with negative real part. Make the change of variables 


() =C !x, yeR*, zeR™* 


and transform (6.7.12) into the form 


y' = Px + F\(y,2), 


2 = 02+ FoWy,2), (6.7.13) 


where 


OF; OF; ; 
F; (0,0) =0, —— (0,0) = (0,0), i=1,2. 
dy Z 


) 
If z = A(y) is an invariant manifold for (6.7.13) with 


h(0) =0 and ~(0) =§. (6.7.14) 
y 


then we define the local center manifold 
Wo ={(y,z) ER’ x R"*: y=AG), Ilyll <4} 


for small 6 > 0. This way, W° is tangent to E* at the origin. We have the following 
theorem. 


Theorem 6.7.5. For system (6.7.13), there exist 5 > 0 and h € C! with h(y) defined 
for all ||y|| <6 such that z = h(y) is a center manifold. 


On the center manifold W°, we get the reduced system 
y = Px+ Fi(y,hQ)), 


and z’ can be calculated on the center manifold in two ways: directly from the z’ 
equation above or by differentiating z = h(y), that is, 


d 
2! = Oz + Fa(y, h(y)) and z= no = Dh(y)y' = Dh(y)[Px + Fi(y, Ay), 


where Dh(y) is the matrix formed by partial derivatives of h(y). Note that in one di- 
mension, Dh(y) = h'(y). Expanding h as a Taylor series (noting that the constant and 
linear terms vanish), the two equations for z’ provide two different polynomials, and 
the coefficients of different monomials can be equated to determine the coefficients 
of the Taylor expansion. We end the section with the following two examples. 
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Example 6.23. Consider the planar nonlinear system 


x’ =xy, 
ya-x—y 


with the only equilibrium solution (0, 0). Linearization around the equilibrium solu- 


tion gives 
0 O 
A= DfIO=(6 a) 


The eigenvalues of A are A = 0, —1 with corresponding eigenvectors (5) and (1). 


Thus the stable subspace is E* = {(x, y) € IR? : x = 0}, and the center subspace is 
E°={(x,y)e€ R?: y = 0}. Since the matrix A is already in normal form, no coordi- 
nate transformation is needed. We consider a center manifold of the form 


y =h(x) = ax? + bx3 +. cx4* + O(x°). (6.7.15) 


There is no constant term and no linear term in h(x) since the center manifold passes 
through the origin and should be tangent to E“. Now we calculate the constants. We 


have 
y= x? y= x? (ax? + bxP + =) + O(x°). (6.7.16) 
Next, we differentiate (6.7.15) with respect to ft. Using the chain rules, we get y’ = 
dh(x) 4 
=x h(x) or 
dt 


y =x'h' (x) =xyh'(x) = x(ax? + bxe+ext+.. -) (ax + 3bx? + 4ex7 +.. ) 
(6.7.17) 


Setting the right side of (6.7.17) equal to (6.7.16) and equating the coefficients at 
2 


x x3, and x* give 
a=-—l, b=0, and c=-2. 
Thus the center manifold is given by 
W* ={(x, y) €R?: y= —x? — 2x}, 
and the dynamics on WS is 


x! =xh(x) = —x? —2x° + O(x’). 


Now for x > 0, we have x’ < 0 and x’ > 0 if x < 0. Thus the origin is stable, and the 
solutions are stable nodes as shown in the graph below, but the motion onto the center 
manifold in the y-direction is much faster than the motion on the center manifold, 
leading to a phase portrait shown in Fig. 6.18. 
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Weiga—r —Or +. 


FIGURE 6.18 


Exponential collapse of trajectories onto the center manifold and then slow convergence 
toward (0,0) on the center manifold. 


The next example shows the need for a transformation. 


Example 6.24. Consider the planar nonlinear system 


(6.7.18) 


beans 
2 


y=x-yr-x 


with the only equilibrium solution (0, 0). Linearization around the equilibrium solu- 


tion gives 
-1 1 
A= pro=({ aoe 


The eigenvalues of A are A = 0, —2 with corresponding eigenvectors @) and fa) ; 


Thus the stable subspace is E* = {(x, y) € R? : y = —x}, and the center subspace is 
E° ={(x, y) € R*: y=x}. 
1 1 -1_1 
Let C= 4 |): Then C = 1( 
x, y coordinates to u, v coordinates by 


1 1 


4 ) Make the change of variable from 


or 
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Under these transformations, system (6.7.18) in the u, v coordinates becomes 
ui =uv—v, v =—2v+uv—w’. 


The new system is now in the normal form since 


Df (0) = ¢ >) 


For similar reasons as in the above example, we define the center manifold h(u) by 
v(u) =h(u) = au? + bur +cut+--- : 
Then using the chain rule, we arrive at 
v= [2a + 3b7u? +4cu2 +.. |w 

= [2aw 43h a+ den? +45; | 

x [a (au? + bu +cu* +...) - (au? + bu? +cu*+...)°| 

Soa i Gab =I We see, (6.7.19) 
On the other hand, using the second equation of the system with v = h(u) gives 

v =—2v+uv—wv? 

= —2(au? + bu? + cut +...) + u(au? + bu? +cu* +...) =_ 


= (2a + l)u? + (2b —a)u? + Bc—b)yut +---. (6.7.20) 


Setting (6.7.19) equal to (6.7.20) and then equating the coefficients at u?, v3, and u* 
give 


2’ = 4’ — 3° 


and it follows that the center manifold in wv coordinates is 


1 1 3 
Wo = {(u, v) ER :v=— Sul — pu — ou +..). 


The dynamics on the center manifold is 


which is stable for small wu. Finally, the center manifold W° in the original coordinates 
x, y is approximated from replacing u with x + y and v with y — x: 


: 1 1 3 
Wo ={(x, ER? :y-x=—-7atyY- Gety- Gat +... 
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6.7.5 Hartman—Grobman theorem 


Consider the nonlinear autonomous system 
x' = f(x), (6.7.21) 


where E C R", and f : E > R" is a C? function. The Hartman—Grobman theorem 
states that near a hyperbolic equilibrium solution xg, the nonlinear system given by 
(6.7.21) has the same qualitative structures as the linearized system 


x’ = Ax, (6.7.22) 


where A = Df (xo). In this section, we assume that xo is the origin, E C R” contains 
the origin, and f(0) = 0. Recall from Definition 6.7.3 that two sets K, and K2 are 
said to be homeomorphic if there is a continuous one-to-one map g : K; — K2 such 
that g~! is also continuous. 

In our case the two autonomous systems (6.7.21) and (6.7.22) are said to be topo- 
logically equivalent in a neighborhood of the origin or to have the same qualitative 
structure near the origin if there is a homeomorphism H mapping an open set U 
containing the origin onto an open set V containing the origin that maps trajectories 
of (6.7.21) in U onto trajectories (6.7.22) in V and preserves the orientation. If the 
homeomorphism H preserves parameterization by time ¢, then (6.7.21) and (6.7.22) 
are said to be topologically conjugate in the neighborhood of the origin. 

We have the following example. 


Example 6.25. Consider the two linear systems x’ = Ax and y’ = By with 


2 -i1 3 0 
a=(2, 3) and B= (5 


lf sd 4 ra @ 
ok Re a ee | 


It is easy to verify that B = RAR~!. Let y = H(x) = Rx or x = R™'y. Then it 
follows that 


Define 


y= RAR '!y= By. 
Suppose x (0) = xo. Then x(t) = e“' xq is the solution of x’ = Ax, x(0) = xo. Simi- 
larly, if y(O) = yo, then y = e®' yo with yo = Rxo. 
Then by (3.4.3) it follows that 
y(t) = A(x(t)) = Rx) = Re“' xo = Re“ R7!yo = eF' yy = e?' Rx 


is the solution of x’ = Bx. In other words, H maps the trajectories of x’ = Ax onto 
trajectories of x’ = Bx and preserves the parameterization by ¢ since 


He =e*'H. 
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Thus H is a homeomorphism, and x’ = Ax and y’ = By are topologically conju- 
gate. 


Next, we introduce the Hartman—Grobman theorem, proved independently by 
Grobman in 1959 and Hartman in 1960. We only offer an outline of the proof, which 
should serve as guidelines on how to find the homeomorphism H. For complete 
proof, we refer the reader to [26] or [33]. In plain language the theorem says that if 
the linearization matrix has no zero or purely imaginary eigenvalues, then the phase 
portrait for the nonlinear system near an equilibrium point is similar to that of its 
linearization. 


Theorem 6.7.6. (Hartman—Grobman theorem) Let f(0) = 0, and let E C R” be 
an open subset containing the origin with f € C!(E). Let ¢; be the flow of (6.7.21). 
Suppose the linearized matrix Df (0) has no eigenvalue with zero real part (the origin 
is hyperbolic). Then there is ahomeomorphism H mapping an open set U containing 
the origin onto an open set V containing the origin such that for each xo € U, there 
is an open interval Ig C R containing zero such that for all xy € U and t € Ip, we 
have 


H 0 $; (xo) =e H (x0). 


In other words, H maps trajectories of (6.7.21) in U onto trajectories (6.7.22) in V 
and preserves the orientation and parameterization by time t. 


Proof. (Outline) Suppose that 


A= Df(0)= ¢ ae 


where all the eigenvalues of the matrix P have negative real parts and all the eigen- 
values of the matrix Q have positive real parts. Let 


y 
xo = a eR’, 
£0 


let ¢; be the flow of (6.7.21) and write the solution 


X(t, X0) = 6: (x0) = tea YO: - 


2(t, yo, Z0) 


for yo and zg in E* and E", respectively. 
Define locally (t = 1) the transformation 


P 
Pig at” yo + Y (xo) 
e229 + Z(x0) 


— (®(x)\ _ (®y,z) 
se (a) = be 3) 


Now for x € R”, define 
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Then 
Hy oT! =e4 oH, 
which component-wise is equivalent to 
cP &(x) = O(c" y+ Y(x), e%z + Za), 
e2 W(x) = O(e? y+ Y(x), e22 + Z(x)). (6.7.23) 
Next, we define a continuous successive approximation from the second equation by 
Wo(x) =z, 
Wri (x) =e "2 Oy (eP yt Y(x), e2z4+ Z(x)), K=0,1,.... 


Then W(x) is a Cauchy sequence of continuous functions, which converges uni- 
formly as k — oo to a continuous function V(x). We write the first equation in 
(6.7.23) by 


e P(x) = O(e Py + Yi (x), e 22+ Z1(x)), (6.7.24) 


where the functions Y; and Z, are defined by the inverse of T, 


—P 
Ty,ga[% %tMO2). 
oe) eae 


With this setup, Eq. (6.7.24) can be solved by the method of successive approxima- 
tions exactly as above with ®p(x) = y. Finally, define the homeomorphism 


1 1 
H =i e 4’ HoT’ ds = e 4’ Hy 0 bs (x, yds, 
0 0 


which satisfies 


Hogi (x,y) =e" H(x, y). 


Remark 6.6. (1) From the computational aspect, Theorem 6.7.6 is difficult to use 
since it requires the computation of the flow, which is not possible in most nonlinear 
systems. 

(2) However, conceptually, it suffices to know that such a homeomorphism exists. 
This allows us to understand the dynamics of the nonlinear system near a hyper- 
bolic equilibrium solution by simply looking at the eigenvalues of the linear system 
x’ = Ax, A= Df (0), obtained from linearizing the nonlinear system near the origin. 


In the next example, we consider a system for which the flows can be computed. 


Example 6.26. Consider 
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with 
YO 
0)= : 
= (27) 
-1 0 
Df) = ( ; '} 
and hence e? = e~!, and e2 =e. The equation y’ = —y has the solution y = yoe~". 


Substituting this solution into the second differential equation and using the variation 
of parameters formula, we arrive at 


1 
z= zoe + zoe ee SY, 
Thus 
-t 
yoe 
$1 (x0) = jefe i OAH _ony |? 
zoe + zy le —e) 
and att = 1, Y(x) = 0, Z(x) = zyq(e —e~?), where x = (y, z). As a consequence, 
e2 (x) = O(c? y + Y(x), e8z + Z(x)), 
which results in 
-1 I 5 2 
eW(x) = O(7!y, 2 + Zyp(e —e)). 
Therefore the successive approximations are given by 


Wo(x) =z, x=(y,2) ER’, 


1 
Wi (x) =e"! Woe ly, ez + PG —e~*)) 
1 
=e [ez+ Pen —e~*)] 


1 
en e)y’, 


1 
Wo(x) =e Wiley, ez + see )y") 
1 1 
= e![(ez + a _ e?)y* + au _ e)e~7y?] 
1 
=z+ 3 _ @ VO" + ey?) 


1 
=z+ 3 Cl He Ve yy", 
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1 
W3(x) =e! Wa(eT!y, eg + ae —e*)y*) 
1 1 
=e Mlez+ x(e—e y+ de UL Fe ey) 
1 
=a G0 =e +29) 


1 
=t4+,0= e3y1te3+eSy?, 


1 
Win(x) = z+ 3 = ev 4+e73 +e hes as (e731) y? 


1 ee 1 1 
ete yD a) ee ey 


n=1 


I, 
= ea ay as m— OOo. 


Thus as m — ov, 
1 
Um(y. > VO,D=zt+ 3" 
uniformly for all (y, z) € IR2. Now the functions Y; and Z are defined by the inverse 


of T, 
—| ePy+Y¥i(y,2) 
TY. 2= : . 
e274 Zi (y,z) 


rmoa=(_, * ds i) 
etn —eSay 


which implies that Y\(y,z) = 0 and Z,(y,z) = —ery”, where r = _ To fully 
determine ®(y, z), we use (6.7.24): : 


However, 


e PO(x)= O(e Py + V(x), e722 + Zi(x)) 
or 
eP(x) = Bey, a ae ery’). 


We define the successive approximations by 


Po(y,z) =y, 
Dy +1(y, Z) =e | Py (ey, e'z —ery*), k=0,1,..., 
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and get 


diy, dJ=y, (vy, DER’. 
Thus 


y 
Ao(y, 2) = ( 1 ) 
Z+3y 


and the homeomorphism H is given by 


1 
Ho.2= | e 45 HoT ds 
0 


1 s —s 
=| ® =) Hol a lds 
0 0 e zes 4 1 2(@s =. e725) 


3 


ao ae 
= = S 
0 0 eS zee 4 zy7(e° _ e725) +4 xyes 
- y 

Z+ xy 


Note that HoT* is taken as the composition or Hp is acting on T°. Let’s dig deeper 
and see what subset gets mapped onto the stable subspace E*. Looking at the cor- 
responding eigenvector of 4 = —1, we see that E* = {(y, z) € R*: z= 0}. We are 
interested in finding the subset such that 


y 
10.0 =( i i cE’. 
Z+3y 


It readily follows that the subset is 
2 he 
LOBE RS 5a oe 


which is the stable manifold W* by simply taking t > oo in the flow. In other words, 
the homeomorphism H maps W® onto E*. In addition, H maps W" = {(y,z) € 
R? : y = 0} onto E“ = {(y, z) € R*: y = 0}. Solving the linearized system y’ = —y, 
2’ =z, we get y=cye! andz=ce! orz= > for constants c), C2, and c. Thus 


Cc 
A(y,z)= H(y, —), 
y 
from which it follows that 


1 5) Cc 
(y,z+ 3) )=(,-). 
y 
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FIGURE 6.19 


Under the homeomorphism H, the phase portrait for the nonlinear system near the origin is 
similar to that of its linearization. 


Thus 
c ol 
l= — Sey. 
ye 
We just showed that, under H, the curve z = 5 - ; y? of the nonlinear system gets 


mapped onto z = : of the linearized system. (See Fig. 6.19.) 


6.8 Exercises 


Exercise 6.1. For the following equations, find the equilibrium solutions, sketch the 
phase line, and determine the type of stability of all the equilibria. 
(a) x’ =x°(4—x). 
1 
(b) x’ =2x(1—x)— ha 
(c) x’ =(4—x)(2—x)?. 
Exercise 6.2. Find the equilibrium solutions in terms of the parameter jz and deter- 
mine their stability. Show that the origin is a turning point and sketch a bifurcation 


diagram and label all branches as stable or unstable. When possible, identify the type 
of bifurcation. 


(a) x’ = wx(1 — x). 

(b) x’ =(@* — p)(1— x). 

Exercise 6.3. Find the equilibrium solutions, determine their stability, and show that 
the origin is a turning point and sketch the bifurcation diagram. 


x’ =x’. 
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Exercise 6.4. For the following equations, show that each of them undergoes a tran- 
scritical bifurcation and find the bifurcation value. Sketch the bifurcation diagram. 
(a) x’ = ux + 2x”. 

(b) x’ = (2+ )x — 5x”. 


Exercise 6.5. Find the equilibrium solution x9 at 49 and use Theorem 6.1.2 to deter- 
mine the type of bifurcation at (xo, 40) for the scalar system 
x =ptxux—e tt. 
Exercise 6.6. Show that 
x= [EX + x? 
undergoes a pitchfork bifurcation at jz = 0 and sketch the bifurcation diagram. 


Exercise 6.7. Complete the proof of Theorem 6.2.1, that is, show that inequality 
(6.2.8) holds on [0, 00). 


Exercise 6.8. Suppose the origin is uniformly stable for the linear system x’ = A(t)x, 
where A(t) is ann xX n matrix with continuous entries. Suppose that F' : [0, 00) x 
IR” — R" is continuous with 


|F(t,x)| <y(t)|x| and [roar <oo, 
0 


where the function y(t) > 0 is continuous. Show that if F(t, 0) = 0, then the zero 
solution of 


x’ = A(t)x + F(t, x), 
is uniformly stable. 
Exercise 6.9. Investigate the stability of each of the equilibrium points for the given 
systems: 
(a) x’ =x —3y+2xy, y’ =4x —6y—xy. 
(b) x’ = 6x —S5y+ x7, y' =2x-—yty?. 
(c) x’ =x —2y+4 3xy, y’ =2x —3y—x?— yy’. 
(d)x’=x-—y,y'=x?-y. 
(e)x/=y?—1,y'=x3-y. 
() x’ = 8x —y*, y =—y +23. 
Exercise 6.10. Consider the system 


x’ =—x+hy, 
y=x-y. 


Show that 


Copyright Elsevier 2022 


ER 


226 CHAPTER 6 Nonlinear systems 


(1) (0, 0) is asymptotically stable if h = 0, 
(2) (0, 0) is asymptotically stable spiral if h < 0, and 
(3) (0, 0) asymptotically stable node if 0 <h < 1. 


Exercise 6.11. Study the stability of the origin for the system 
x! =ythx(x* +y°), 
y =—x+hy(@* +y*). 
(Hint: use polar coordinates.) 
Exercise 6.12. Study the stability of the origin for the system 
x’ =-2x-y +x7y, 
y’ =4x + py—y? 
for uw #2. 


Exercise 6.13. Use polar coordinates to study the stability of the origin for the system 


x = —y—xf/x2+y2, ya=x—yyfx2+y?. 


Exercise 6.14. Show that the system 


e Pier ieee ghee y(l—x?—y’) 
has a limit cycle. 
Exercise 6.15. Show that the system 
x =ytx(l—x?—y"), y'=—x+y(1—2x*—y’) 
has a limit cycle. 
Exercise 6.16. Consider the system 
x’ =4x +4y— x(x? + y’), 
y =—4x + 4y — yx? +9’). 


(a) Show that there is a closed path in the region 1 <r <3, where r? = x7 + y?. 
(b) Find the general solution. 


Exercise 6.17. Show that x” + x’ + f(x) =0 has no periodic solution. 


Exercise 6.18. Determine the region on which there is no periodic solution for 


x" + B(x? — 1)x’ +x =0. 
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Exercise 6.19. Consider the predator-prey model 
x’ =x(1—-x)-y), y =y@-a), a>0, 


where x(t) and y(t) are the numbers of preys and predators at time f, respectively. 
(a) Sketch the nullclines and indicate the direction field. 

(b) Find and analyze the equilibrium points. 

(c) What can you say for each of the cases a > 1,a= 1/2, and0 <a <1? 


Exercise 6.20. (a) Prove Theorem 6.4.2. 
(b) Use (a) to show that the system 


x’=x(A—ax+by), y'=y(B-—cy+dx), 


where a, b, c, d, A, and B are constants with a, c > 0, has no closed trajectories or 
periodic orbits. 

(Hint: let h(x, y) = 4.) 

Exercise 6.21. Use polar coordinates to study the stability of the origin for the system 


/ 


y ’ x 
> y=-yt ; 
Ln(./x2 + y2) Ln(/ x2 + y?) 


Exercise 6.22. Consider the nonlinear system 


1 1 
x’ =y+ oxi - 207 +y)], y =—x+ i= (x? + y?)]. 


(a) Show that (0, 0) is the only critical point. 
(b) Show, using polar coordinates (r, 0), that 


1 1 
ii = qr ul + sin?(0)] — P 


(c) Find the region R of Theorem 6.4.4. 
Exercise 6.23. Consider the nonlinear system 
x =e y= 07, 7 oe y=9' 


Given that (0, 0) is the only critical point, use polar coordinates to show that there is 
a limit cycle in the region 


R={(r,0):1<r < V2}. 
Exercise 6.24. Use Theorem 6.6.1 to show that the system 
x’ =xu—y—x>—xy’-y, yl=xtyu-y—x’y 


undergoes a Hopf bifurcation, that is, the system has a stable periodic solution with 
radius ,/[A. 
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Exercise 6.25. Decide if Theorem 6.6.1 applies to the van der Pol equation given in 
system form by 


x’=y, y=—x—p(x?— Dy. 

Exercise 6.26. By solving each of the systems below find E*, E“, M*, and M". 
(a) x’ =—2x, yw =3x4+y. 
(b) x’ = 2x —y, y’=—y. 
Exercise 6.27. By solving the following system find E*, E”, M*, and M": 

Xi =-—-X1, X5 =Xx2 +x?, x3 =0. 
Exercise 6.28. Use the method of Example 6.21 to find M* and M“ for 
x, =-—-X, X54 = 2x2 +x?, 
Exercise 6.29. Use the method of Example 6.21 to find M* and M“ for 


/ 3 / 3 
Xp = XL — X54, Xp = XQ24X}j- 


(Hint: Find the first four successive approximations to u(t, a), u® (t, a), u(t, a), 
4 ( 
u(t, a).) 


Exercise 6.30. In Example 6.23, find the center manifold using 
y=h(x)= ax? + bx? + cx4 + dx? + ex® + O(x'). 
Exercise 6.31. Find the center manifold W° of the system 
ae Ws 
{: =—x?—y. 


Exercise 6.32. Find the center manifold W° of the system 


x’ =x+2y—xy, 
y’ =2x +4y— y?. 


Exercise 6.33. For Example 6.26, verify that 
e“'H(y,z) =H odi(x, y). 
Exercise 6.34. Find the homeomorphism H for the nonlinear system 


y=yt2?, 
7 =z. 
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Exercise 6.35. Approximate the homeomorphism H, W*, and W“ for the nonlinear 


system 
y=; 
Yy=—ye+ye, 
Z=zt+y;} 


Exercise 6.36. Consider the two linear systems x’ = Ax and y’ = By with 


—3 0 -l -2 
A=(5 ) and Cee =): 


Find the homeomorphism H so that e’4 H = He!®. 
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Lyapunov functions 


Lyapunov functions are named after Aleksandr Mikhailovich Lyapunov, a Russian 
mathematician, who defended the thesis The General Problem of Stability of Mo- 
tion at Kharkiv University in 1892. Lyapunov was a pioneer in creating the global 
approach to the analysis of the stability of nonlinear dynamical systems. His work, 
initially published in Russian and then translated to French, received little attention 
for many years. The current use of Lyapunov functions has proved that Lyapunov was 
ahead of his time in developing his theory that is being used in many different areas 
of sciences. In theory Lyapunov functions are scalar functions that may be used to 
prove the stability of equilibrium of a given dynamical system. Since the inception of 
Lyapunov functions, their successful usage has been extended to integral equations, 
integro-differential equations, and functional differential equations. 


7.1 Lyapunov method 


The existence of Lyapunov functions is a necessary and sufficient condition for sta- 
bility in differential equations. There are no concrete procedures on how to find 
Lyapunov functions, but in some cases, the construction of Lyapunov functions is 
known. In the particular case of homogeneous autonomous systems with constant 
coefficients the Lyapunov function can be found as a quadratic form. As we will see 
later, Lyapunov functions allow us to study the stability of nonlinear dynamical sys- 
tems when the equilibrium solution of an associated linear differential equation is a 
center. 
Let D be an open set in R” containing 0, and let fg be any initial time. Define 


V :[to, co) x D— [0, 00), 


where V is any differentiable scalar function. If w : [to, oo) x D — D is any dif- 
ferentiable function, then V(t) := V(t, &(t)) is a scalar function of it, and using the 
chain rule, we can compute its derivative 


aV OV OV 
VO=—wW a+... + —w (+ —. 
(t) aoe +5, Ot 5, 
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Let f : [fo,00) x D— R” with f(t,0) = 0. Assume the existence of the unknown 
solution x : [t9, 00) > D for all (t*, xg) € [tg, 00) x D and consider the system 


x’ = f(t, x), (7.1.1) 
where 


fit, x) 
f2r(t, x) 
f(t,x)= 


fnlt, x) 


Then it follows from the above argument that 


V(t, x() = me ju x(t) +. 
a OO x) 


ax, fn(t, x(t) + + (7.1.2) 


Thus expression (7.1.2) defines the derivative of the function V (¢, A) along the un- 
known solutions of (7.1.1). Note that if VV = grad V = Gy, ee ae ¥, then expres- 
sion (7.1.2) takes the form 


aV 
V'(t, x(t) = grad V- f (t,x) + ra 
where “-” represents the dot product. 
Suppose we are able to find V such that for any (t, x) € [f9, 00) x D, we have 


“ei Ce eee 1 SEO x(t)) + ~ <0. 


Then along the solutions of (7.1.1), we have V’(t, w(t)) < 0. Since V is nonincreas- 
ing along the solutions and V is increasing in |x|, with some work, we are able to get 
the boundedness of solutions and stability of equilibrium solutions. 

The discussion that we gave above regarding the derivative of the function V is 
not rigor, and more precise definitions and conditions must be imposed. We start with 
the following definition. 


Definition 7.1.1. Let D C R” be an open set containing the origin, and let V(t, x) : 
Rt x D— R bea given function. Then we define W = R* x D and 


Vio.ay(t, x(t) = lim sup MAES NAGE) go egy 


hot h 


where f is the right-hand side function of (7.1.1). 
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Let x(t) be a solution of (7.1.1) and define 


V(t, x(t)) = limsup VE+h, xG +h) — VG xO) 
h->0+ h 


Definition 7.1.2. Suppose V(t, x): R+ x D — R? is Lipschitz in x (uniformly in 
t € R*), that is, there exists L > 0 such that for all t € Rt, 


V(t, x1) — V(t, x2)| < Lilx1—x2||, x1,x2 € D. 


We further assume that V(f, x) is continuous in ¢ and Lipschitz in x (uniformly 
in t) with Lipschitz constant L > 0. We have the following lemma. 


Lemma 7.1. Let x(t) be a solution of (7.1.1). Then 
V(t, x(t)) = Voaayt. x(t)). (7.1.3) 
Moreover, if Q : W — [0, 00) is continuous such that 
V(t, x(t) < —Q(t, x(t)), (7.1.4) 


then 


12 
V(t, x(t2)) — Viti, x(t) S -| Ot, x(t))dt, O<t <hr. (71,5) 
t 


1 


Proof. First, we note that since V is a Lipschitz function, we have 
—L||x1 — x2|| < V(s, x1) — V(s, x2) S L||x1 — xa||, 520, x1,%2 € D. 
Let x(t) be a solution of (7.1.1). Then 


V(it+th,x(t+h)) — V(t, x(t)) 
=V(tth,xt+h))—-Vit+th,x+hf(,x)) 
+V(t+th,x+hf(t,x))-V@,x(@). 


Divide the above expression by h, take limsup,_,9+, and then apply the Lipschitz 
condition to get 


Vit+th,x(t+h)) — V(t, x()) 


lim su 
Ae h 
. Vat+h,x+hf(t,x)) —Vt,x@) 
< lim sup 
h-0+ h 
t+h)—x(t)—hf(t, x(t 
Ae fy |x(t+h)-— x) —hf(t,x@)ll 
h—>0+ h 
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VaEth,x thf, x) —V@,x@) 
= lim sup 

h>0+ h 
+ Lx’ — f(t, x)Il, 


which gives 


Vi0s0) Sine 
7 h->0+ h 


=Voirnt2x0). 7.1.6) 


In a similar way, but reversing the use of Lipschitz inequality, we get 


V(it+th,x(t+h)) — V(t, x(t)) 


lim sup 
hot h 

. Vit+h,x+hf(t,x)) —Vit,x@) 
> lim sup 

hot h 

_ Ila +h) —x@) —hf xO) 
L lim 
h>0+ h 

: Vitth,x +hf (t,x)) — V(t, x(t) 
= lim sup 

hot h 
— Lx’ — f(t, xl, 


which gives 


V(it+h, hf (t, — VG, 
V'G.x@)) = limsup WET%* + AFG =) — VOX) 
h—->0+ h 


=VornG20). C1 


This shows that 
V(t, x(t) = Vara, x(@)). 


As for (7.1.5), we integrate both sides of (7.1.4) from t to t2. This completes the 
proof. 


Remark 7.1. Lemma 7.1 states that the derivative of V with respect to (7.1.1) is the 
derivative of V along the solution of (7.1.1) and is given by (7.1.2). 


The situation is considerably simplified when V is independent of t¢. In this case 
(7.1.2) simplifies to 


OV aV 
V'(x(t)) = a fit. x(0) Seg ae halt x(t)). (7.1.8) 


Recall that if x* is an equilibrium point of (7.1.1), then the change of variables x = 
y + x* translates every nonzero equilibrium solution to the origin. 
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Definition 7.1.3. Let D be an open set in R” containing 0. A continuous autonomous 
function V : D > [0, oo) is positive definite if 


V(0) =0 and V(x) > 0 forx £0. 
The function V is said to be negative definite if —V is positive definite. 
Definition 7.1.4. Let D be an open set in R” containing 0. Let 
V:D-— [0,o«) 
have continuous first partial derivatives. If V is positive definite and 


OV (x(t dV (x(t 
Va) = SE) AR) sane i oe) 0) <0 
Ox] OXn 
for (t,x) € [f9, 00) x D, and x #0, then V is called a Lyapunov function for sys- 
tem (7.1.1). 


If the inequality is strict, that is, V’(x(t)) < 0, then V is said to be a strict 
Lyapunov function. 


—_—_—_— 1 


Damping b 


FIGURE 7.1 


Damping harmonic motion. 


Consider the damped harmonic motion depicted in Fig. 7.1, where m, k are pos- 
itive constants and a > 0. If x is the displacement of the mass from its equilibrium 
position, then applying Newton’s second law to all forces acting on the system, we 
arrive at the second-order differential equation 


mx" + bx’ +kx =0. 


We introduce the transformation x; = x and x2 = x’ and arrive at the system 


j ‘ k b 
Xy=X2, Xp =——X1 — —X. (7.1.9) 
m m 
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Clearly, if b = 0, then linearization gives no information regarding the stability of the 
origin. Next, we try to construct a Lyapunov function that overcomes such difficulties. 
Since we are dealing with a physical system, we expect that the system energy will 
decrease over time to zero. Thus a logical choice for a Lyapunov function would be 
the sum of kinetic energy and spring potential energy, that is, 


1 1 
V(x) = s(x’)? as she. 


Clearly, V is positive definite, and 


WV’ =mx'x" +kxx' 


— x!(mx" + kx) 
= x/(—bx’) 
= —b(x'). 


Later on, we show that this is enough to demonstrate that the origin is stable. We 
make the following definitions regarding stability. 


Definition 7.1.5. 
x’ = f(t, x), (7.1.10) 


where x(t) € IR”. Assume that f is continuous and locally Lipschitz with respect 
to x. Let t > x(t, to, x9) denote the maximal defined solution of (7.1.10) satisfying 
the initial condition x(t) = xo. Let 


@ :[to, 00) > R" 


be a solution of the differential equation (7.1.10). 


(a) We say that the solution @ is stable (S) on [to, 00) if for each ¢ > 0, there is 
56 = d(to, €) > 0 such that whenever |@(to) — xo| < 6, the solution x(t, fo, xo) is 
defined for all t € [to, o©), and 


|(t) — x(t, to, Xo)| < € forall t >t. 
(b) We say that the solution @ is uniformly stable (US) on [fo, co) if it is stable 
and given € > 0 as before, 5 in (a) is independent of fo and such that whenever 
|b(to) — xo| < 4, the solution x(t, to, xo) is defined for all t € [t9, oo), and 


|P(t) — x(t, to, xo)| <e€ forall t >t. 


(c) We say that the solution ¢ is asymptotically stable (AS) on [to, 00) if it is stable 
and given ¢ > 0 as before, there is 6; < 6 such that whenever |@(tg) — xo| < 61, 
we have jim |P(t) — x(t, to, Xo) | = 0. 
00 
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(d) If @ is not stable, then we say that it is unstable, that is, there is some ¢ > 0 
such that for every 5 > 0, there is some point xo with |6 (to) — xo| < 6 such that 
|d(t1) — x(t1, to, Xo)| = € for some f; € [f9, 00). 

(e) We say that the solution ¢ is uniformly asymptotically stable (UAS) on [fp, 00) if 
itis US and there exists y > 0 such that for each yz > 0, there exists T = T (2) > 
0 such that | (to) — xo| < y, t = to + T, implies |x(f, to, x0) — O(1)| < Le. 


Since any equilibrium solution can be translated to the origin, we have the equiv- 
alent definitions regarding the zero solution x = 0. 

Let f :[f9,0co) x D— R” with D Cc R” containing the origin. Assume the exis- 
tence of the unknown solution x : [t9, co) — D on each (t*, x9) € [fo, 00) x D and 
consider system (7.1.1) with the initial condition x(to) = xo and f(t, 0) =0. 


Definition 7.1.6. The zero solution (x = 0) of (7.1.1): 


(a) is stable (S) if for all ¢ > 0 and fo > 0, there is 5 = 5(tp, €) > O such that 
|x (to)| < 6 implies |x(t, to, x0) |<, 

(b) is uniformly stable (US) if 6 in (a) is independent of to, 

(c) is unstable if it is not stable, 

(d) is asymptotically stable (AS) if it is stable and jim, |x(t, to, xo)| = 0, and 


(e) is uniformly asymptotically stable (UAS) if it is US and there exists y > 0 such 
that for each jz > 0, there exists T = T(t) > O such that |x(t)|<y,t>to+T, 
implies |x(f, to, x0) | < LU. 


Thus x = 0 is stable if solutions starting near x = 0 do not wander too far from 
x = 0 in future time. Now x = 0 is asymptotically stable if it is stable, and solu- 
tions near x9 approach 0 as t > oo. The next result is useful in constructing positive 
definite or negative definite functions and is stated in the following theorem. 


Theorem 7.1.1. For constants a, b, and c, the function 
Va,y= ax? + bxy+ cy” 
is positive definite if and only if 
a>0 and 4ac —b? >0 
and is negative definite if and only if 
a <0 and 4ac—b? > 0. 
Example 7.1. Consider the planar system 
x/=—x—xy’, 
yl =-y— yx, 
Set 
V(x, y) = ax? + bxy +cy’. 
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Computing the derivative of V along the solutions of the system, we obtain 
V(x, y) = —2[2a(x? + x7 y?) + bQxy + xy? + yx?) + 2e(y? +. x7y?)]. 


If we choose b = 0, a > 0, and c > 0, then V’ is negative definite, and V is positive 
definite by Theorem 7.1.1. 


7.1.1 Stability of autonomous systems 


Let D be an open subset of IR” containing 0, and let f : D— R” with f(0) = 0. 
Assume the existence of the unknown solution x : [t9, 00) — D for each (t*, x9) € 
[tg, 00) x D and consider the system 


x’ = f(x), x(0) =x, t>0, (7.1.11) 
where 
fi) 
f2(x) 
oe 
Tn) 


Note that Definitions 7.1.3, 7.1.4, and 7.1.6 carry over to the autonomous system 
(7.1.11). We make the following definitions regarding an open ball so that we may 
state the stability notion in terms of such balls. 


Definition 7.1.7. Let x* € R”" andr > 0. Then B,(x*) denotes the open ball centered 
at x* with radius r, that is, 

B,(x*) = {x ER": ||x —x*|| <r}. 
Definition 7.1.8. The equilibrium point x* of (7.1.11): 


(a) is stable (S) if for each ball B,(x*), there is a ball Bs(x*) (6 < ©) such that if 
x € Bs(x*), then x(t, x9) remains in the ball B,(x*) for t > 0, 

(b) is asymptotically stable (AS) if it is stable and there is a ball B.(x*) such that 
for each x € B,(x*), x(t, x9) > 0 as t > oo. 


We warm up with the following example. 


Example 7.2. The origin (0, 0) is the only equilibrium solution and is a node for the 
system 
x'=—x, 
/ 


yy: 
We apply Definition 7.1.8. The solution is easily computed and is given by 
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for x(O) = c, and y(O) = cp. For all ¢ > 0, let 6 = e > 0. Then for all c € Bs(0) = 
{(x, y) € R*: Vx? + y? < 6} and t > 0, we have 


lox, l= x2 + 2 = fe2 +e <b=e. 
It follows that 


(x(t, 0, c1), y(t, 0, c2)) € Bs (0), 


and hence (0, 0) is stable. Moreover, 
(x(t, 0, c1), y(t, 0, c2)) > (0,0) as t > co 


shows that (0, 0) is AS. 
Theorem 7.1.2. Let V(x) be a Lyapunov function in D, that is, V : D — [0, 00), 


V(O)=0, V(x)>0, and V’ <0 forx 40. 
Then the zero solution of (7.1.11) is stable. 


Proof. Pick ¢ > 0 such that the ball B,(0) is in D. Let S, be the boundary of B, (0). 

Due to the continuity of V at the origin and V(0) = 0, there must be a point on S; 

where V attains its minimum, which we denote by m = min V(x) > 0. Let Bs(0) be 
xES, 


another ball in D. Since V(0) = 0 and V is continuous we can choose 6 > 0 such that 
V(x) <™m for all x € Bs(0). Our goal is to show that if x9 € Bs(0), then x(t, 0, x9) € 
B,(O) for all t > 0. Since V’ < 0, then V(xg) < m implies that V (x(t, 0, x9)) < m for 
all t > 0 because the nonpositivity of the derivatives implies that V does not increase 
along the orbits with the initial condition xg. This in turn implies that x(t, 0, xo) 
cannot cross S, since V(x) > m for all € S,. This implies that the origin is stable. 
This completes the proof. 


Example 7.3. Consider the planar system 


x =-—y+xy, 
y=x—x’, 


Clearly, (0, 0) is an equilibrium point of the system. The linearization theorem, The- 
orem 6.2.1, is inconclusive since (0, 0) is a center for the linear part 


Moreover, using the method of polar coordinates gives no information about the sta- 
bility of the origin. Let us try to construct a Lyapunov function. Let a and b be positive 
constants and set 


V(x, y) = ax? + by’, 
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where a and b are to be determined. It is clear that V(0, 0) = 0 and V(x, y) > 0 for 
(x, y) # (0, 0). 


Computing the derivative of V along the solutions of the system using (7.1.8), we 
obtain 


V(x, y) =axx' + byy’ 
=ax(—y + xy) + by(x — x?) 
=0 


by setting a = b > 0. The simplest choice would be a = = b. In this case, 


1 
Vix, y)= 5 +"). 


Thus by Theorem 7.1.2 the origin is stable. 
Here is another example. 


Example 7.4. Consider the three-dimensional system 


Clearly, (0, 0, 0) is an equilibrium solution of the system, and 


—2 


0 0 
J(0,0,0)=];1 0 O 
0 0 0 


Thus J (0, 0, 0) has the eigenvalues A; = 0 and A2 = A3 =i ./2. The linearization the- 
orem, Theorem 6.2.1, cannot be applied. Let us try to construct a Lyapunov function. 
Let a, b, and c be positive constants and set 


V(ix,y= ax? + by” Ler, 
where a and b are to be determined. It is clear that V(0, 0) = 0 and V(x, y, z) > 0 for 
(x, y, z) # (0, 0, 0). Computing the derivative of V along the solutions of the system 


using (7.1.8), we obtain 


V(x, y) =axx' + byy’ +. cz2z' 
= ax(—2y + yz) + by(x — xz) + ez(xy) 
=2[(a—b+c)xyz+ (—2a+c)xy]. 


Copyright Elsevier 2022 


TT CCCCC“‘(UCOCts‘(#USN“N#U(W”N”N”NONCOCssiCa=qEe 


7.1 Lyapunov method 241 


Hence if b = 2a and c=a > 0, then V’(x, y, z) =0 for all (x, y,z) € R°?, and there- 
fore by Theorem 7.1.2 the origin (0, 0, 0) is stable. Furthermore, choosing a =c = | 
and b = 2, we see that the trajectories of this system lie on the ellipsoids 


424 2aK 
for positive constants k. 


Example 7.3 reveals the advantage of the use of Lyapunov functions over lin- 
earization since it showed that a center for a linear system is stable for the accompa- 
nying nonlinear system. 

The next theorem provides criteria for asymptotic stability. 


Theorem 7.1.3. Let V(x) be a strict Lyapunov function in D, that is, V : D— 
[0, 00), 


V(0)=0, V(x)>0, and V’ <0 forx £0. 
Then the zero solution of (7.1.11) is asymptotically stable. 


Proof. Since the origin is stable and V’ < 0 along the solutions of (7.1.11), it follows 
that V (x) decreases to the value c as t — oo. The proof will be complete if we show 
that c = 0. Assume for contradiction that c > 0. Then there exists B < ¢ (¢€ from the 
stability theorem) such that V(x) < c for all x € Bg(0). However, then x(t) cannot 
enter Bg(0). Let 


m=min{—V’: B < |x| <e}. 


As —V’ > 0, we have that V’ < —m for all t > 0. An integration of V’ < —m from 0 


to t yields 
V(x(t)) — V(x) S mt. 
Thus jim V(x(t)) = —«, which contradicts the assumption that V is positive defi- 
—>0o 


nite in D and tends to c as t > oo. Hence c must vanish. 

We next claim that x(t) > 0 as t > oo. If this is not the case, then there are 
constants a > 0 and a sequence ft, — oo such that |x(t)| > a for all k. Since the 
closure Bp (0) is compact and all the points x(t.) € Bz (0), there is a subsequence that 
converges to a point z € Bg(0). We may assume that x(t,) — z, and we must have 
0 4 |z| >a. By the continuity of V we have that V(x(t,)) > V(z) > 0. However, 
since t, — oo, we must have V (x(t,)) — c = 0, which is a contradiction. Thus the 
origin is asymptotically stable. This completes the proof. 


Example 7.5. Consider the planar system 
‘4 


x =—-x a3, 


y' =—y +3x7y. 
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Clearly, (0, 0) is an equilibrium point of the system. The linearization theorem, The- 
orem 6.2.1, tells us that (0,0) is AS. We verify the result by constructing a strict 
Lyapunov function. Let a and b be positive constants and set 


Vix,y)= ax? + by’, 


where a and b are to be determined. Clearly, V(0, 0) = 0 and V(x, y) > Ofor (x, y) 4 
(0, 0). Computing the derivative of V along the solutions of the system using (7.1.8), 
we obtain 
V(x, y) =axx' + yy’ 
= ax(—x — xy*) + by(—y + 3x*y) 
= —2ax? Qax*y? 2by? + 6bx* y" 
= —(6x* +2y”) <0 


unless x = y = 0, where we choose a = 3, b = | to eliminate the mixed terms. Thus 
by Theorem 7.1.3 the origin is asymptotically stable. 


Note that the origin (0, 0) of the system in Example 7.1 is asymptotically stable 
by Theorem 7.1.3. 


Let V(x) be a strict Lyapunov function in D. Then domain of attraction of an 
equilibrium consists of all points such that a solution starting at them tends to the 
equilibrium. In engineering applications, it is often important to get an estimate of 
the size of the domain of attraction. Thus if V is a strict Lyapunov function on a set 
D € R’, then the origin is asymptotically stable, and the domain of attraction is 


N={xeD: V(x) <C} 


for some positive constant C. 
Example 7.6. Consider the planar system 


/ 
x =-x-y, 


y=2x-yty’. 
Clearly, (0, 0) is an equilibrium point of the system. Set 
2 
Vix, y) =x*+ ca 
2 
Clearly, V(0,0) = 0, and V(x, y) > 0 for (x, y) ¥ (0, 0). Computing the derivative 
of V along the solutions of the system, we obtain 
V'(x, y) = 2x! + yy’ 
=2x(-x — y) + yQx—yty*) 
= —2x? — y? 4 y4, 
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To keep V’(x, y) < 0, we must restrict y so that —y* + y+ = y?(—1 +4 y*) <0, that 
is, —1 < y < 1. On the other hand, to keep the ellipses V(x, y) = x7 + + = C inside 


D={(x,y):x €R, —1 < y < 1}, we must take 0 < C < 5. Thus for any value of 
such C, the origin is asymptotically stable, and the domain of attraction is 


2 1 
Be VG): 
The next theorem only asks for the existence of a Lyapunov function to obtain the 
asymptotic stability but with a catch. 
Theorem 7.1.4. Let V(x) be a Lyapunov function in D. Let 
Z={x:V'(x) =0,x € D}. 


Suppose that the only bounded solution of (7.1.11) that remains inside Z all the time 
is the equilibrium solution 0. Then the origin of (7.1.11) is asymptotically stable. 


Proof. Theorem 7.1.4 is a particular case of Theorem 7.4.2, and we ask the reader to 
either wait or flip the pages. 


As an application of Theorem 7.1.4, we provide the following example. 
Example 7.7. Consider the planar system 
x’ =-x—2y, 
y’ = 3x —2y. 
Clearly, (0, 0) is an equilibrium point of the system. Set 
x 9 


Clearly, V(0, 0) = 0 and V(x, y) > 0 for (x, y) ~ (0, 0). Computing the derivative 
of V along the solutions of the system, we obtain 
V'(x, y) = xx! + 2yy’ 

= x(—x — 2y) + 2y(3x — 2y) 

= —(x —2y)?. 
It is clear that V’(x, y) = 0 if x = 2y. Thus V(x, y) is a Lyapunov function (not 
strict) on the set 

Z ={(x, y) €R*:x =2y}. 


Let (x, y) be a bounded solution (trajectory) in Z, that is, there exists a positive 
constant K such that |x|, |y| < K. Substitute x = 2y into the original system to get 
x’ = —2x and y’ =4y. By straightforward calculations we obtain the solutions 


x(t) =x(O)e~~ and y(t) = y(O)e™, 
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respectively, for f € R. These functions cannot satisfy |x|, |y| < K, unless x(0) = 
y(0) = 0. To have you more convinced, the solutions must also satisfy x = 2y, or 


x(O)e~~! = 2y(O)e™, 


which can only hold if x(0) = y(O) = 0. Thus the only bounded solution in Z is the 
origin, and hence by Theorem 7.1.4 the origin is asymptotically stable. 


The next theorem provides criteria for instability of the zero solution of (7.1.11). 


Theorem 7.1.5. Let D be an open set in R” containing 0. Let V : D — [0, 00) be 
continuous real-valued scalar differentiable function that is positive definite on D. If 
V'(x) > 0 for x £0, then the origin of (7.1.11) is unstable. 


Proof. Assume that the zero solution is stable. Then, for ¢ = 1 and tg = 0, there exists 
56 > 0 such that |xo| < 6 implies that |x(¢, 0, x9)| < 1. Hence for x(t) = x(t, 0, xo), 
V (x(t)) is bounded for t > 0 when |xo| < 6. Fix xg with |xo| = 5 such that V (x9) > 0. 
Since V’ > 0, it follows that V is increasing along the solutions. Therefore we have 
V(x(t)) = V(xo) > 0, t = 0. Since V is continuous and V(0) = 0, there exists p € 
(0, 1) such that p < |x(t)| < 1,¢ > 0. Since V’ > 0 along the solutions of (7.1.11) and 
positive on the closed and bounded set p < |x(t)| < 1,wehave! = min V’(x) > 0. 


ps|x|<1 
Thus 
t d t 
Vex) = Vero) = | LVorsyds f lds =I(t —ty) ~~, t> &. 
o ds 0 


This contradicts the fact that V(x(t)) is bounded for t > 0 when |xo| < 6. It follows 
that the zero solution x(t) = 0 is unstable. 


Example 7.8. Consider the planar system 
x’ =2xy+ ae 
y’ = _ x? +4 ae 


Clearly, (0, 0) is an equilibrium point of the system. Linearization will not work here 
since there are no linear terms at (0, 0). Set 


V(x, y) =x 4 ay, 


Clearly, V(0, 0) = 0 and V(x, y) > 0 for (x, y) € (0, 0). Computing the derivative 
of V along the solutions of the system, we obtain 


V'(x, y) = 2xx' +4yy’ 
= 2x(2xy +. x°) + 4y(—x? + y°) 
=2x4+4+4y°s0, (x, y) 4 (0,0). 


It follows from Theorem 7.1.5 that the origin is unstable. 
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Example 7.9. We examine the stability and asymptotic stability for different values 
of a for the planner system 


x’ =ax(x?+y*)—xy’, 
r 2 2 2 
y Saya +y )+x"y. 


Clearly, (0, 0) is an equilibrium point of the system. Linearization will not work here 
since there are no linear terms in the neighborhood of (0, 0). Set 


Vix,y) =x? + y?. 


Clearly, V(0, 0) = 0 and V(x, y) > 0 for (x, y) £ (0, 0). Set V(t) := V(x(t), y(t). 
Then along the solutions of the system we have that 


V'(t) = 2xx' + 2yy’ 
= 2x[ax(x? + y*) — xy*] + 2ylay(x? + y*) + x7y] 
=Iatx? +57). (7.1.12) 


It is clear from relation (7.1.12) that the origin is stable if a = 0, asymptotically stable 
if a < 0, and unstable if a > 0. In the following, we will use expression (7.1.12) and 
try to understand the behavior of the Lyapunov function along the solutions. 

We observe that (7.1.12) is equivalent to 


V'(t) =2aV7(t), 


which is a separable first-order differential equation in V(t). Thus separating the 
variables and then integrating from 0 to ¢ gives 


Vit= i i (7.1.13) 


——______  t> 
—2aV(0)t ~— 


Case 1. If a = 0, then from (7.1.13) we have that V(t) = V(0) = x(0)* + y(0)? > 0. 
In this case, we have a periodic solution surrounding the origin 


oS 


for nonzero constant k. Hence the origin is stable. 


Case 2. If a < 0, then from (7.1.13) we have that V(t) — 0 as t > on, that is, 
x* + y? — 0 as t — oo, which means that the solutions spiral toward the origin, 
and we conclude that the origin is asymptotically stable. 


Case 3. If a > 0, then by (7.1.13) V(£) is not defined for all t > 0. In fact, V(t) + oo 


ast —> SEV from the left. We conclude that the origin is unstable. 


The next theorem provides criteria of the instability of the zero solution, which is 
different from that given in Theorem 7.1.5. 


Copyright Elsevier 2022 


a 


246 CHAPTER 7 Lyapunov functions 


Theorem 7.1.6. Let x* be an equilibrium solution of (7.1.11). Let U be a neighbor- 
hood of x*. Let V : U — R be a continuously differentiable function on U, except 
perhaps at x*. If V(x*) = 0, but there are points arbitrarily close to x* where V is 
strictly positive and V' > 0 on U \ {x*}, then x* is unstable for (7.1.11). 


Proof. Without loss of generality, we take x* = 0. Let Bg(0) C U, B > 0. We may 
choose a point x9 € Bg(0) close to 0 such that V(xo) > 0. Let (a, b) be the interval 
of existence of the solution x(t) = x(t, xo). The proof will be completed if we can 
show that x(t) is outside the ball B (0). Assume the contrary, that is, solutions stay 
in Bg(O) for all t = 0. Since Bg(O) is compact, V achieves its maximum, say Vo € 
Bg(0). Thus 


V(x(t)) < Vo, t= 0. (7.1.14) 


Since V’ > 0 and V is increasing along the solutions and V’ > V(x) > 0, we can 
find p > O such that V(x) < V(x) for x € By (0). Then x (f) is trapped in the compact 
annulus p < |x| < 6. Let 


m=min{V': p < |x| < B}. 
An integration of V’ > m from 0 to t yields 
V(x(t, xo)) = V(xo) + mt, 


which contradicts (7.1.14) since the right side goes to infinity as ¢ goes to infinity. 
Thus the solution x(t) must escape Bg (0), and the origin is unstable. This completes 
the proof. 


Lyapunov functions can also be used to determine limit cycles, as the next exam- 
ple demonstrates. 


Example 7.10. In Example 6.15 we considered the planar autonomous system 


/ 


x =—y—xG?+y?—p), y =x—yO?+y"? =p) 


with yz > 0 and used polar coordinates to show the existence of a stable limit cycle. 
In this example, we use a Lyapunov function to arrive at the same result. Let 


Vanyax ty’, 
Then along the solutions of the system we have the expression 
V'(t) = 2xx' + 2yy’ 
= 2x[-y — x(x? + y? — w)] + 2ylx — yO? +" — p)] 


= —2(x? + y? — w)(x? + y’) 
= 2(u— V(x, y)) V(x, y). 
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Now since V > 0, the sign of V’ depends on the term xp — V(x, y). We have V’ =0 
if V = pw or x* + y* =p, which is a circle centered at the origin with radius ju. If 
0 < V <p, then V’ > 0. In this case the trajectories start inside the circle with radius 
j4 and move upward toward it but do not cross it due to uniqueness. If V > jz, then 
Vv’ <0. In this case the trajectories start outside the circle with radius 4. and move 
toward it but do not cross it due to uniqueness. We conclude that x* + y? = pu is 
a stable limit cycle. 


The next example shows the importance of Theorem 7.1.6 and illustrates its usage 
as Theorem 7.1.5 is not applicable. 


Example 7.11. Considered the planar autonomous system 
x’ =3x+ y’, y =-2y x, 


Clearly, the origin is the only equilibrium point of the system. We easily conclude that 
(0, 0) is unstable using the linearization method. Let us see how we can implement 
Theorem 7.1.6. We consider the Lyapunov function 


2 2 
x“ oy 
VOI a 5: 


There are points in the neighborhood of the origin where V is positive, for example, 
the points on the x-axis. Since we are only interested what happens in the neighbor- 
hood of (0,0), we limit ourselves to |x| < 1 and |y| < 1. To better understand the 
derivative of V, we will utilize the inequality 


0<(a—b)? =a? —2ab+b’ 
for all real numbers a and b, from which it follows that 


2 2. 
a b 
b<—+—. 
meZts 


It readily follows that along the solutions of the system, 
V! = (3x? + 2y’) + (xy* — x°y). (7.1.15) 
Next, we compare the term (3x2 + 2y?) with (xy? _ oy): 
Jxy? — x? y| < [xylly — x?| 
1 
<5 @? +)? + lyD 
I 9 2 
< 507+ yal + ID 
1 
2 


< 


Cx] + ly) dal + ly) 
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1 
= 5 (lel? + IP) + ally! 


< Sx? + IP) + 5 xP + 9) 
=x24y? 
OES gat PA ge 
Thus a substitution into (7.1.15) gives 
V'@)  |xy? — x? y| + Gry’ — 2° y) > 0 


for (x, y) 4 (0, 0). We conclude that V’ > 0 on the set |x|, |y| < 1 minus the origin, 
and by Theorem 7.1.6 the origin is unstable. Note that the set U of Theorem 7.1.6 is 
defined by 


U={x,yeER: |x| <1, |y| < 1}. 


Theorem 7.1.6 also has its limitation since there may be some points near the 
equilibrium solution x* that approach x*, which makes it difficult to have V’ > 0 on 
a whole neighborhood of x*. The next generalization theorem is due to Cetaev. 


Theorem 7.1.7. (Cetaev) Let x* be an equilibrium solution of (7.1.11) contained in 
the closure of an open set U, and let E be a neighborhood of x*. Let V : E > R be 
a continuously differentiable function on E such that 

(1) V and V’ are both positive on (U M E) \ {x*}. 

(2) V(x) =0 on the part of the boundary of U that is in E. 


Then the equilibrium solution x* is unstable. 


Proof. Exercise. 


Next, we briefly discuss a special class of Lyapunov functions that includes the 
absolute value of the unknown solution. Let x : R > R be continuous. Observing that 


|x| = Vx? = (x2)? 


and using the chain rule, we arrive at 


4 eo = CcOy ee (2x(t)x'(t)) 
dt a 
= me, 
(x?(t))2 
x(t) 


a ie 


We have the following lemma. 
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Lemma 7.2. Let x :R > R be differentiable. Then 


d x(t) , 
— |x) = x(t). 
dt |x (t)| 
Example 7.12. Consider the scalar nonlinear Volterra integro-dynamic equation 
' x(t) 
x(t) =ax(t)+b 7 ; [0, 00). (7.1.16) 
1+ to x2(s)ds 
Suppose there exists a constant 6 such that 
a+ |b|= 8. 
Consider the function 
V(t, x) = |x(t)|. 
Then by Lemma 7.2, we have 
d x(t) 
V’'(t,x) = —|x(t)| = ——x'(t 
(2) = 7 le@) mo” © 
t t 
= 20 (axe p20) 
|x(t)| 1+ fo x2(s)ds 
, 1 x x(t) 


= ax 7 
Ix(@)| [x] 1+ fp x?(s)ds 
1 
<a|x| + |b||x| —————_ 
eal FES EOr 
<alx| + ||Ix| 
= (a+ |d)lal. 


Then it follows from Theorems 7.1.2—7.1.5 that the zero solution of (7.1.16) is stable 
if 6B = 0, asymptotically stable if 8 < 0, and unstable if 6 > 0. 


7.1.2 Time-varying systems; non-autonomous 


Now we turn our attention to systems that explicitly include the variable time f. 
Such systems are referred to as non-autonomous systems. Thus we consider the non- 
autonomous system 


x’ = f(t, x), (7.1.17) 


where f € C([0, oo) x D,R"), where D C R" is open with 0 € D. We say that 
a vector x* € R” is an equilibrium solution, or constant solution, or equilibrium point 


of (7.1.17) if 
f(t,x*) =0. 
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This is the perfect place to make clear that the existence of equilibrium points for 
non-autonomous systems may depend on the initial time. To see this, we consider 


1 
x= (: ) ey t>0, x(0) = xo. 


The system has a unique equilibrium solution (0,0), provided that the matrix is 
non-singular, which is the case for t ~ 1. Thus, in this case, the system attains an equi- 
librium solution if and only if the initial time fo > 1. 

Definition 7.1.6 of stability carries over to (7.1.17). In addition, the uniform 
asymptotic stability for (7.1.17) is equivalent to the asymptotic stability for au- 
tonomous system. We begin by considering the initial value time-varying scalar 
differential equation 


x’ = (6t sin(t) — 2t)x, x(to)=x0, to >0. 


Its unique solution passing through (fo, xo) is given by 


t 
x(t) =x0 exp ( / (6s sin(s) — 2s)ds) 
1 
= Xo exp (6 sin(t) — 6t cos(t) — t* — 6 sin(to) + 69 + 6t cos(to) + ib), 
Set 
a med (6 sin(t) — 6f cos(t) — 17 — 6 sin(t)) + 619 + 619 cos(to) + i). 


Then 


Ix(t)| < |xole@o)|, t= to. 


E 


amy 8° that 


Thus for any ¢ > 0, choose 6(fo, €) = 
|xo| < 6 == |x(t)| <6, 


and hence the zero solution is stable but not uniformly stable. Note that c(t) increases 
as fg increases, and hence 6 shrinks as fg increases and ft is fixed. To be more specific, 
suppose to = 2n7,n =0,1,2,..., and x(f) is evaluated z seconds later in each case. 
Then 


X (19 +1) = x(IoeFNCO™, 
and if x (to) 4 0, then we get 


X(to +7) 
X(to) 


>oast—ow. 


Thus there is no 6 independent of fo that would satisfy the requirement for uniform 
stability. 
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Definition 7.1.9. A strictly increasing continuous function W : [0,0o) —> [0, co) 
with W(0) = 0 is called a wedge. (In this book, wedges are always denoted by W 
or W;, where i is a positive integer.) 


Definition 7.1.10. Let D be an open set in R” containing 0. A continuous au- 
tonomous function V : [0, 00) x D — [0, oo) is positive definite if 


V(t,0) =0 and V(t,x) >0 forall x £0 and all t € [0, ov). 


Thus V (f, x) is positive definite if and only if there is a wedge independent of time ¢ 
such that V(t, x) > W(|x|) forall x € D. 


Definition 7.1.11. Let D be an open set in R” containing 0. Let 
V :[0, co) x D—= [0, oo) 


have continuous first partial derivatives. If V is positive definite and 


V'(t,x() = fie, x@)) + +++ + ——— fat, x) + 


aV(t, x(t)) aV(t, x(t)) aV(t, x(t)) 24 
Ox] OXn ot ~ 


for (t,x) € [fo, 00) x D with x £0, then V is called Lyapunov function for system 


ceiey 


If the inequality is strict, that is, V’(t,x(t)) < 0 then V is said to be a strict 
Lyapunov function. 


Definition 7.1.12. Let D be an open set in R” containing 0. Let 
V :[0, 00) x D—= [0, 00). 


We say V(t, x) is: 


(a) decrescent in D if there is a wedge W, such that 
Vit, x) < Wi (|x|) for all x € D, 


(b) radially unbounded if V(t,x) — oo as |x| — oo, which means that for each 
M > 0, there is N > 0 such that V(t,x) > M for all ¢ € [0, oo) and all x such that 
|x| > N, 


(c) both positive definite and decrescent if 
Wi (|x|) < VG, x) < W(x). 


Theorem 7.1.8. Let D C R" be an open set containing the origin, and let V(t, x): 
[0, 00) x D > [0, 00) be a given continuously differentiable function satisfying 


V(t, 0) =0, (7.1.18) 
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Wi(|x|) < V(x), (7.1.19) 
and 
V'(t,x) <0 forall t>0 and x £0. (7.1.20) 


Then the zero solution of (7.1.17) is stable. 


Proof. By (7.1.20), we have V’(t,x) < 0, V is continuous, V(t,0) = 0, and 
Wi (|x|) < V(t, x). Let ¢ > 0 and to > 0. We must find 6 such that |xo| < 6 and 
t > to imply |x(¢, fo, xo)| < ¢. (Throughout these proofs, we assume that ¢ is small 
enough so that |x(t, fo, xo)| < € implies that x € D.) As V is continuous in ¢ and x 
and V(t, 0) = 0, there is 6 > 0 such that |xo| < 6 implies V (to, x9) < Wi (e). Thus if 
t > to, |xo| < 6, and x = x(f, fo, xo), then we have 


Wi(lx@|) < VG, x) < Vo, x0) < Wile). 
Applying W,_ to both sides of the above inequality gives 


Ix(t)| Se. 


This completes the proof. 


Theorem 7.1.9. Let D C R" be an open set containing the origin, and let V(t, x): 
[0, 00) x D — [0, o0) be a continuously differentiable function. Assume that (7.1.18), 
(7.1.19), and (7.1.20) hold. If, in addition, V satisfies 


V(t, x) < Wa([xI), (7.1.21) 
then the zero solution of (7.1.17) is uniformly stable. 


Proof. For a given €, we choose 6 > 0 such that W2(5) < Wi (e), where W, (|x|) < 
V(t, x) < W2(|x|). If t9 => 0, then we have 


Wi ([x(t)|) < V(t, x) < V(to, xo) 
< W2(|x0l) < W2(d) < Wi(e), 


or |x(t)| < €, as required. This completes the proof. 
The next example shows that V’(t, x) < 0 is not enough to drive solutions to zero. 


Example 7.13. Let g :[0,00) > (0, 6B] with g(0) = 1 and 0 < B < 1. Consider the 
non-autonomous first-order differential equation 


x'(t)=[¢'()/g |x. (7.1.22) 
It is clear that x(t) = g(t) is a solution of (7.1.22). Our goal is to construct a function 


V(t, x) =a(t)x*(t) 
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such that V’(t, x) = —a(t)x(t), where a(t), a(t) > 0 fort € R*, and [>° a(s)ds < 
oo. Along the solutions of (7.1.22) we have 


g(t) 
g(t) 


V' (t,x) = [a’(t) + 2a(t) —— ] x7 (0). 


By substituting V’(t, x) = —a(t)x?(t) we arrive at 


a'(t) + 2a = wie, 


It readily follows that the solution is 
t 
a(t) = [a(0)g*(0) — [ a(s)g*(s)ds]g*(t) 
t 
> [a(0)22(0) — p? [ a(s)ds]/¢2(0). 


Since 0 < g < | and fouls) < oo, we may choose a(0) large enough to imply 
that a(t) > 1 on [0, oo). Thus we have shown that V > 0 and V’ <0 do not imply 
that solutions tend to zero. As a matter of fact, there is no wedge W2 with V(t, x) < 
W2(|x|). Notice that V is not decrescent. 


Theorem 7.1.10. Let D C R” be an open set containing the origin, and let V(t, x): 
[0, 00) x D — [0, 00) be a continuously differentiable function satisfying (7.1.18) 
and (7.1.19). If, in addition, 


V(t, x) < —W3(|x|) forall t= 0, (7.1.23) 
then the zero solution of (7.1.17) is asymptotically stable. 


Proof. By Theorem 7.1.8, the zero solution is stable. Therefore given ¢ > 0, there are 
6 >O and y > 0 such that 


Y <|x(t,t0,x0)| <€, tt, |xo| <6. 


Due to (7.1.23) and |x(f, to, xo)| => y for t > to, there exists a constant d > 0 such 
that 


V(t, x) <—d <0 forall t > f. 
An integration of V’ < —d from fo to t yields 
V(t, x(t, to, Xo) < V(to, xo) — d(t — 0). 


Thus jim V(x(t)) = —oo, which contradicts the assumption that V is positive def- 
=> oo 


inite. Hence no such y exists, and since V(t, x) is a positive decreasing function, it 
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follows that jim V (x(t)) = 0. Therefore 
oo 
lim x(t, to,xo) =0 
too 


which implies that the zero solution is asymptotically stable. This completes the 
proof. 


Theorem 7.1.11. Let D C R” be an open set containing the origin, and let V(t, x): 
[0, 00) x D = [0, 00) be a continuously differentiable function satisfying 


V(t, 0) =0, 


Wi(lx|) < Vt. x) < Walle), 
and 
V' (t,x) < —W3(|x|) forall t > 0. 
Then the zero solution of (7.1.17) is uniformly asymptotically stable. 
Proof. By Theorem 7.1.9, the zero solution is uniformly stable. Let ¢ = 1, and find 


5 > 0 of uniform stability and call it 7. Let y > 0 be given. We must find T > 0 such 
that 


lIxol<n, to>0, and t>t4+T 


imply |x(t, to, xo)| < y. Pick uw > 0 with Wo(u) < Wi (y), so that there is t; > to with 
|x(t1)| < yw. Then we have, for t > ty, 


Wi(lx@) <VG,x) < VG, x1) 
< W2()x11) < Wo(n) < Wily), 


or |x(t})| < y. Since V’(t, x) < —W3(|x|), and so as long as |x(t)| > yw, it follows 
that V’(t, x) < —W3(y). Thus 


t 
V(t, x(t) < VC, 0) = f W3(|x(s)[)ds 
i) 


< W2(xol) — W3(w)(t — to) 
< W2(7) — W3(u)(t — to), 


which vanishes at 


W. 
tap + 2M 5 tr, 
W3 (2) 


W. Wp 
where T > ns. Hence, if T > fora , then |x(t)| > 2 fails, and we have |x(t)| < y 


for all t > t9 + T. This proves UAS. 
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Example 7.14. Consider the second-order differential equation 
u” + e(t)u =0, 
where e is continuously differentiable with 
e’(t) <0 and jim, e(t)=e9>0. 


Making the substitution x =u, y =u’, we arrive at the equivalent system 


/ 


x’=y, y’=—e(t)x. 
Let 


V(t, x) = e(t)x? + y’, 


where x = @: Then along the solutions we have 


V(t, x) =e’ (t)x* + 2e(t)xy — 2e(t)xy 
= e' (t)x* 
<0. 


It is clear that V(t, 0) = 0. We will show that the zero solution is uniformly stable us- 
ing Theorem 7.1.9 if we show that Wj (|x|) < V(t, x) < W2(|x|). Since e is decreasing 
and its limit at infinity exists and is equal to eg, we may let 


c =min{eo, 1} and k = max{e(0), 1}. 
Then we can define 
Wi (|x|) =c(x? + y) =c|x|, and Wo(|x|) =k(x* + y*) = Aix, 


so that we have Wj (|x|) < e(t)x? + y? < W2((|x|). This implies that the zero solution 
is uniformly stable. 


Example 7.15. Consider the system 
x} =-xX)-— en x, x5 =X] —X2. 
Here (0, 0) is the only equilibrium solution. Let 
V(x, x2) = a +(1+ ee 
Then along the solutions we have by Definition 7.1.11 that 


v'(t, X1,X2) = —2[x7 — X1Xx2 al =o 2e~**)]. 
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x? x2 
Using x1x2 < 3 + }, we arrive at 
V'(t,x1,%2) = -2(x7 + x3(1 + 2e~*")) + 2x1x2 

< (x? + ro + 436°") 

<—(p +9) = —Wa((x)). 
In addition, if we set 

Wi (ix) = sce +23), Wa(lxl) = xp + x3, 
then we have 
Wi(lx|) < VG, x) < Wallx)), 

and by Theorem 7.1.11, the origin is uniformly asymptotically stable. 


Remark 7.2. Theorems 7.1.8—7.1.10 hold for the autonomous system (7.1.11) with 
autonomous V (x). 


7.2 Global asymptotic stability 


In this section we briefly discuss the notion of global asymptotic stability. 


Definition 7.2.1. Assume that the zero solution of (7.1.11) is stable. If |x (f, to, x9)| > 
0 as t > oo for every x (fo) = xo, then we say that the zero solution is globally asymp- 
totically stable (GAS). 


Remark 7.3. Theorem 7.1.10 implies the zero solution is GAS if D = R”. 
In addition, for the next theorem we note that (7.1.19) implies 


V(x) > oo as ||x|| > 00, 
since Wj (|x|) > 00 as |x| > oo. 
Example 7.16. Consider the system 
x} = —x,(1 — 2x12), x5 =—Xx2. 


It is clear that (0, 0) is the only equilibrium solution. Let 


1 
V(x, x2) = mal + x2, 


Then along the solutions we have 


V' (x1, x2) = —x? (1 — 2x1 x2) — 2x3. 
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Now V’(x1, x2) < 0 if 1 — 2x,x2 > 0, that is, if xyx2 < 7 Thus the origin is asymp- 
totically stable but not GAS since we are confined to the bounded region that consists 
of all points (x1, x2) such that x;x2 < 5 Therefore we cannot conclude that the zero 


solution is GAS. 
We state the following theorem regarding GAS. 


Theorem 7.2.1. Suppose the hypothesis of Theorem 7.1.3 holds with D = R". In 
addition, if V(x) is radially unbounded, that is, 


V(x) > 00 as ||x|| > 00, (7.2.1) 


then the zero solution of (7.1.11) is GAS. 


Proof. By Theorem 7.1.2, the zero solution is stable. Suppose there is a solution or 
trajectory that does not converge to zero. Since V is decreasing and nonnegative, it 
converges to some y as ft — oo. Since x does not converge to zero, we have y < 
V(x(t)) < V(xo). Let 


L={z:y < V(z) < V(x0)}. 


Then L is closed and bounded and hence compact. Therefore V attains its supremum 
on L, that is, sup,<7 V’ = —d <0, or V’(x(t)) < —d for all t > fo. An integration of 
V’ <—d from 0 to T yields 


VQ@(T)) < Vo) — aT. 


This implies that V(xo) < 0 for T > V(xq)/d, which is a contradiction, and hence 
every trajectory converges to zero. This completes the proof. 


Basically, the conditions on V imply that every trajectory x(t) tends to the origin 
as t — oo. Since x(t) is continuous, this requires that x(t) remains bounded for all 
t > to for arbitrary initial conditions x (to). Hence the purpose of the radial unbound- 
edness condition on V is to ensure that x(t) remains at all times within the bounded 
region defined by V(x) < V(x). If V were not radially unbounded, then not all level 
curves given by V(x) < c for positive constant c would be closed curves, and it would 
be possible for x(t) to drift away from the equilibrium even though V’ < 0. 


Example 7.17. The zero solution of the system in Example 7.5 is GAS. 
Example 7.18. Consider the system 
a x2 


xi =(%) —1)x3, xh= : 
ae ae eee ae ee 


It is clear that (0, 0) is the only equilibrium solution. Let 


x2 
V(x, x2) = —— + x2, 
1+x; 
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Then along the solutions we have 


xy x2 
2,2, 2 22 
(l+x2)2 “14x2 


V' (x1, x2) = —2 


so that V(x1, x2) is a strict Lyapunov function on the set D = R”, as required by 
Theorem 7.1.3, and the zero solution is AS. However, V is not radially unbounded 
since the level curves for V = c are not closed curves for c > 1. Thus it is not possible 
to conclude that the zero solution is GAS. Neither is it possible to conclude that 
the zero solution is not GAS without further analysis, since we might find another 
function V that satisfies all the requirements for the GAS. 


FIGURE 7.2 


Level curves escaping to infinity. 


As a matter of fact, according to Fig. 7.2, the zero solution is not GAS since 
solutions escape to infinity with the choice of the initial condition (xj (to), x2(to)) = 
(3, 3/2). 


Remark 7.4. We examine in detail why 


2 


V(x1, x2) = i + x3 
1+x7 


is not radially unbounded. As mentioned above, the condition that V(x) is radially 


unbounded means that all level sets are closed. Letting x2 = 0, we try to determine 
2 


x 
the level set V(x) = 1 or V(x, 0) = i : 5 = 1, which cannot hold for finite x1. 
+x 


Thus V is not radially unbounded. Next, we examine the definition of being radially 
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unbounded in the context of 
V(x) > © as ||x|| > oo. 


This means that any combinations of x;, x2 that make ||x|| — oo also have to make 
V(x) — oo. The Euclidean norm 


(x1, O)||2 = \/x? + 0? = Yoo? + 0? > 0. 


However, in this case, we get for V(x) that 
lim V(x1,0)=140. 
Xj 0O 


It follows that V is not radially unbounded. 


7.3 Instability 


We consider once more the non-autonomous system 
x'= f(t,x), f(t,0)=0, (7.3.1) 


where f € C([0, oo) x D, R"), and D C R” is open with 0 € D. We have discussed 
the instability for autonomous systems, but let us recall that if we negate the definition 
of stability, then there are ¢ > 0 and fg > 0 such that for any 6 > 0, there are x9 with 
|xq| < 6 and f; > fp such that 


|x(t1, fo, x0)| = €. 
Then the zero solution is unstable. We make the following formal definition. 


Definition 7.3.1. The zero solution of (7.3.1) is unstable if there are e > 0 and 
to => 0 such that for any 56 > 0, there are x9 with |xo| < 6 and ¢; > to such that 
|x(t1, to, xo)| = €. 


Theorem 7.3.1. Suppose V : [0, 00) x D — [0, 00) is a continuous function locally 
Lipschitz in x such that 


Wi([xl) < VG, x) < Wa([xI), (7.3.2) 
and along the solutions of (7.3.1) we have 
V(t, x) = W3(|x\). (7.3.3) 


Then the zero solution of (7.3.1) is unstable. 
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Proof. Suppose not. Then for e = min{1, d(0, 0D)}, where 0 D denotes the boundary 
of the set D, we can find 6 > 0 such that |xo| < 6 andt > O imply that |x(¢, 0, x0)| <e. 
We may pick xq such that |xo| = 6/2 and find y > 0 with W2(v) = W, (6/2). Then 
for x(t) = x(t, 0, x9), we have V'(t, x) = 0 by (7.3.3), so that 


Wo(lx@)) 2 VG, x()) 2 VO, xo) = Wi (6/2) = Waly), 
from which we conclude that y < |x(t)| for t > 0. Thus 
V'(t, x) = W3(Ix(2)|) = W3(). 
It follows that 
Wa(lx@)) = VG, x(@)) = VO, x0) + tW3(y), 


from which we conclude that |x(t)| — oo, a contradiction. This completes the 
proof. 


We ask the curious reader to compare condition (7.3.2) with the hypothesis of 
Theorem 7.1.6 and try to have an appreciation and some understanding of the differ- 
ences between autonomous systems and non-autonomous systems. 

In Theorem 7.3.1 we asked for |xo| = 6/2, which is too much to ask. This will be 
relaxed in the next theorem. 


Theorem 7.3.2. Suppose that V : [0,00) x D— (—00, 00) is a continuous function 
locally Lipschitz in x and that there is a sequence Xn, € D starting at to => 0 with 
V(to, Xn) > O and xn > Oasn— ov. If 


Wi (x1) < V(t, x) < Wo([x|) 
and if along the solutions of (7.3.1) we have 
V(t, x) = Wa(IxI), 
then the zero solution of (7.3.1) is unstable. 


Proof. Suppose not. Then there are ¢ and 6 as in the proof of Theorem 7.3.1. For 6, 
we may find f, and x, with |x,| <6 and V(t,,x,) > 0. The rest of the proof is 
identical to that of Theorem 7.3.1. This completes the proof. 


7.4 @-limit set 


We discuss the Krasovskii—LaSalle invariance principle, which provides a way to 
prove the asymptotic stability when V’ is negative semi-definite. It is usually much 
easier to construct such a function V. We begin with the following definition. 
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Definition 7.4.1. Let D be an open subset of R” with 0 € D. A continuous au- 
tonomous function V : D — [0, oo) is 


(a) positive definite if 
V(0) =0 and V(x) > 0 forx 40, 
(b) positive semi-definite if 
V(0) =0 and V(x) >0 forx £0. 
To illustrate the differences, consider the two functions 
Vi (x) = te and V2(x) = a +22, 


Clearly, both functions are nonnegative. However, it is possible for V; to be zero even 
when x + 0. Particularly, if we set x = (0, d) where d € R is any non-zero number, 
then Vi (x) = Vi (0, d) = 0, whereas V2(x) = 0 if and only if x = 0. We conclude 
that V; is positive semi-definite and V) is positive definite. 


Remark 7.5. If the signs on V’ are reversed in Definition 7.4.1, then V is said to be 
negative definite and negative semi-definite, respectively. 


Let f : R” — R” be continuous with continuous first-order partial derivatives 
with respect to xj,i = 1,2,...,n. Consider the initial value autonomous system 


w= FG); 2e) =; Fem (7.4.1) 


Let x* be an equilibrium solution of (7.4.1). 
Let x(t, to, Xo) be a trajectory of (7.4.1) at time ¢ starting from xo at the initial 
time fo. Denote the set of all points lying along the trajectory by x(-, fo, xo) 


Definition 7.4.2. (w-limit set) The w-limit set of a trajectory x(-, fo, xo) is the set of 
all points z € R” such that 


lim x(t, t, Xo) = Z, 
noo 
where the sequence 1, is strictly increasing. 


Definition 7.4.3. (Invariant set) The set M € R” is said to be an invariant set if for 
all ye M and fg > 0, we have 


x(t,to,y)€M forall t >t. 


Theorem 7.4.1. Let V be a Lyapunov function of (7.4.1) on a bounded open set 
U € R" with x* € U. Let c be a positive constant, and set 


S={xeU: V(x) <c}, 


which is closed in R". Then S is invariant for t > to = 0. 
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Proof. Let x € S. Since V is a Lyapunov function on U, we have that V (x(f, fo, xo)) < 
V(xo0) < c for t > to > 0 as long as the solutions exist. Now since S is closed and 
bounded, the existence of solutions holds for all t > t9 > O. As a result, x(t, to, x0) 
remains in S for all t > to > 0. This shows that the set S is invariant. This completes 
the proof. 


In Example 7.3 we considered V(x, y) = x7 + y* and obtained V’ = 0. As a result 
of Theorem 7.4.1, we have that the set 


S={(x, y)€R?:x*+y? <c} for c>0 
is invariant. 


Theorem 7.4.2. (Krasovskii-LaSalle invariance principle) Let D be an open subset 
of IR” containing x*. Let V : D > R be a positive definite function such that on the 
compact set 


Q, ={xe D: V(x) <r, r>O}, 
we have V'(x) < 0. Define 
S={x €Q,:V'(x) =0}. 


Then, as t > ©, the trajectory tends to the largest invariant set inside S, that is, its 
o-limit set is contained inside the largest invariant set in S. If S contains no invariant 
sets other than x = x*, then the equilibrium solution x* of (7.4.1) is asymptotically 
stable. 


Proof. Let M be the largest invariant set in S, and let L* be the w-limit set for the 

trajectory x(t, to, xo), which is invariant. Since V’(x) < 0 and is continuous in Q,, 

we have that V(x) > b= 7 V(x) > 0. Thus there is a positive constant a such that 
x€EQ, 


lim V(x(t, to, Xo)) =a. 
t>oo 
Now x(t, fo, Xo) € &, implies x(t, fo, x9) is bounded, which implies that LT exists. 


Moreover, L* € Q,, and x(t, fo, xo) approaches L* as t > oo. For any z € L*, there 
is an increasing sequence {t,} such that 


lim x (ty, to, x0) = Z. 
n—->Oo 
As V(x) is continuous, we have that 
V(z) = lim V(x(h, to, X0)) =a. 
n—- Oo 


Since V(x) =a on L* and L* is invariant, we get that V’(x) = 0 for all x € Lt and 


LT CMCSCQ,. 
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Thus x(f, fg, x9) > LT, and hence x(t, fo,.x9) ~ M as t > oo. This completes the 
proof. 


We provide a couple of examples. 


Example 7.19. Consider the system 


’ 
x =y, 


y=-O8 -x5)-y3. 


Let D = {(x, y):x* + y* < 1} and define 


-& 
lon 


Xx Xx 


y? 
VN Per eh gg 


Then V is positive definite on D. We can easily verify that V’ = —y*. Thus V’ = 0 
along the x-axis, and V’ is negative semi-definite. Note that on D, we have V(x, y) < 
nae Cae 5 Thus @ (Ce. ED Pit. 5M 

= —. Thus Q, = {(x, : < . More- 
G7 A- 2 4°J2 16 r y 7° 4G > 6 


over, 


S={(x, y) €Q,: V(x) = 0} = {(x, y) € Q sy =O}. 


Now V is constant only on solutions that lie on the x-axis, but by the uniqueness 
of solutions, the only such solution is the equilibrium (0, 0). Thus M = {(x, y)€S: 
x =0, y = 0} is the largest invariant subset of $. By Theorem 7.4.2, we have that all 
trajectories in S go to (0, 0) as t > oo. Note that the other two equilibrium solutions, 
(—1, 0) and (1, 0), are outside the set Q,. 


Corollary 7.1. If the hypotheses of Theorem 7.4.2 hold with D = R" and V(x) is 
radially unbounded, then the origin is GAS. 


Example 7.20. Consider the system 


x! = y, 
y’ = —hy(x) — ha(y), 


where the functions 4; and h2 are continuous and satisfy 
hj(0O) =0, uhj(u) > 0, i=1,2, for 0< |u| <a. 


Let D = {(x, y): |x| <a, |y| <a} and set 


y x 
Vaya> +f hi(s)ds. 
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Then V(0, 0) = 0 and V(x, y) > 0 on D. In addition, 


V'(x, y) = Ay (x)x' + yy’ 
=hi(x)y + y[ —h1@) —Aay)] 
= —yho(y). 


Now V’(x, y) = 0 implies yh2(y) = 0, and hence y = 0. Thus V’ = 0 along the 
x-axis, and V’ is negative semi-definite. Note that on D, we have 


Vays + [as = ag 
2 0 2 
Thus Q, = {(x, y)€ D: V(x, y) < 347}. Moreover, 
S={(x, y) € Qa: V(x) =0} = {, y) € Qa y =O}. 
As y(t) = 0, we have y’(t) = 0. The second equation of the system gives 
hy (x(t)) + h20) = hi@(t)) =0, 


from which we have x(t) = 0. Hence the only solution that can stay identically in $ 
is (x(t), y(t)) = (0, 0), that is, M = {(x, y) © S: x =0, y = 0} is the largest invariant 
subset of S$. Thus the origin is asymptotically stable by Theorem 7.4.2. 

u 


Now we suppose a = oo and hi(s)ds > o as |u| > 00. Then D = R?, and 
0 
Vix,y= + + de h1(s)ds is radially unbounded. Moreover, 
S={(x, y) € Qa: V(x) = 0} = (x, y) € Qa: y =O}, 


and the only solution that can stay identically in S is (x(t), y(t)) = (0, 0). Thus the 


origin is GAS. Note that we did not have to worry about the set Q, since a = oo or 
D=R’. 


We end this section by revisiting the pendulum with friction that we considered 
in Examples 3.5 and 6.9. 


Example 7.21. In Example 3.5 we considered a pendulum with friction and arrived 
at the planar autonomous system 


taxa; 
b 
x= = sin(x1) — x9, (7.4.2) 


We are interested in examining the stability of the zero solution by constructing a suit- 
able Lyapunov function. Let D = {(x1, x2) € R? : |x1| <7} and set 


1 
V(x1,2%2) = + (1 —cos(x1)) + 5: 
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Then V (0, 0) = 0, and V (x1, x2) > 0 on D — (0, 0). Moreover, along the solutions of 
(7.4.2) we have 


V' (x1, x2) = - sin(x1)x} + X2X5 
_ 8 : Be as b 
= Fhe sin(x,) + xo( 7 sin(x1) — 32) 
=—-——X7. 
Now V’ = 0 along the x-axis, and V’ is negative semi-definite in D. Let 
S={(x,y)€D:V'(x) =0}. 


As x2(t) = 0, this implies that x (t) = 0, and x; (f) is constant. Similarly, for x2(t) = 
0, this implies that x5 (t) = 0, and hence sin(x;) = 0. However, the only point on the 
segment —z < x1 < rendering sin(x;) = 0 is xj = 0. Hence the only solution that 
can forever stay in S is (x1(¢), x2(t)) = (0,0). Thus M = {(x, y)—e S:x =0, y=0} 
is the largest invariant subset of S, and the origin is asymptotically stable by Theo- 
rem 7.4.2. 

Again, there was no need to construct the set Q, since a = oo. 


We end this section by giving an example in which we expose the difficulties 
of using Theorem 7.1.3, which requires V to be a strict Lyapunov function, and the 
advantage of using Theorem 7.4.2. First, we state the following lemma. 


Lemma 7.3. (Young’s inequality) For any two nonnegative real numbers w and z, 
we have 


w zf . 1 1 
wz< + with -+ —=1, e, f € (, 0). 
e f e f 


Example 7.22. Consider the autonomous system 


x= = =H, y=x. 
We see that (0, 0) is the only equilibrium solution. Let D = {(x, y) € R?: |y|* < 1/2} 
and set 


Vix,y= x +xy? + 3y*. 


We need to show V is a strict Lyapunov function on the set D. Clearly, V(0, 0) = 0. 
We need to worry about the mixed term xy*. Let e = 6 and f = 6/5. Then by 
Lemma 7.3, for |y| < 1, we have 


6 18/5 
S|y| 1 5 
3) = 3) 2 nd < —x® - 
Ixy"| = |xlly 1s 6 + a =e + ¢y 
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This implies that 
18 3 
Pe ee ir eee 
v2 ery |= 
Substituting 3y” into V gives 
3 18 
Vix,y)= a" ay? _ 5° + zy" 
2 13 
= x? tay? + ley l+ Slay?| 
5 5 
2 
aor + oh ae 
Along the solutions of the system we have 
Vey) S60 4 ey 9", 


Next, we apply Lemma 7.3 to reduce the two mixed terms. Let (x, y) € D. Lete= 
8/3 and f = 8/5. Then 


ee ee ee, 
—x3 y3| = |x x ‘ 
. _ 8 es wad 


and similarly, if we let e = 8/6 and f = 8/2, then 


Shx8 | Wy _ 9184 3,8 


Bey Sie Sal A ri ri 


Thus 


3 9 5 3 
Vay = 6x8 + oS + x8_ yt 4 Dy4 4 “8 


Te. 4 gS gl 
ae yt ey NG) 
27 3 
wag ay? 20 
8 16 


on D — {(0,0)}. By Theorem 7.1.3, the zero solution is asymptotically stable. Next, 
we use Theorem 7.4.2. Let 


Vix,y= Pare ay 
Clearly, V (0, 0) = 0, and V(x, y) > 0 for (x, y) ¥ (0, 0). Moreover, 
V(x, y) =—6x° <0. 


Thus V’ = 0 along the x-axis, and hence V is a Lyapunov function (semi-definite). 
Here D = R?, and 


S={(x,y)€D:V'(x) =0}. 
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As y = 0, this implies that y’ = 0, from which we have x> = 0, that is, x = 0. Thus 
M = {(x, y) € S:x =0, y = O} is the largest invariant subset of S, and the origin is 
asymptotically stable by Theorem 7.4.2. 


7.5 Connection between eigenvalues and Lyapunov 
functions 


Consider the homogeneous system 
x'(t) = Ax(t), (7.5.1) 


where A is an n X n constant matrix. We are interested in relations between the 
existence of a Lyapunov function for system (7.5.1) and its eigenvalues. It turns out 
that if all the eigenvalues of A have negative real parts, then there is a strict Lyapunov 
function. We begin with the following definition. 


Definition 7.5.1. Let x € R”, and let B be ann x n constant matrix. We say that B 
is positive definite (negative definite) if 


x’ Bx >0(<0) for x £0. 


Example 7.23. Let 


1 0 0 1 
B=l= . and x = ” 
0 0 1 mi 
Then 
1 0O 0 <j 
x! Bx = (x1, %2,---5Xn) O 1: = 
0 7 0 i) 


=x? txe+...t22>0 for x 40. 
Thus the n x n identity matrix J is positive definite. 


To better understand where we are heading, we assume the existence of a positive 
definite symmetric n x n constant matrix B and define 


V(x) =x! Bx. (7.5.2) 
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Then V(x) is positive definite, and, moreover, along the solutions of (7.5.1) we have 
that 


Vi(xy= (x?) Bx +x! Bx’ 
— (x’)? Bx +x? Bx’ 
= (Ax)! Bx + x" B(Ax) 
=x! A’ Bx +x" BAx 
=x"(ATB+BA)x. (1.53) 


Notice that 


T 
(47B ce BA) = BTA+ATBT 
=A'B+BA. 


Thus A’ B + BA is symmetric, and so is A? B + BA = —C for a symmetric ma- 
trix C; we wish —C to be negative definite to obtain stability results concerning 
system (7.5.3). 


Remark 7.6. If (7.5.2) holds, then there are positive constants a; and a2 such that 
ax x <x! Bx <anx' x. (7.5.4) 
Then Wj (|x|) =a x! x and W2(|x|) = a2x! x could serve as two wedges such that 
ax? x <V(x)< ax! x, 
We have the following theorem. 


Theorem 7.5.1. Given ann x n constant matrix A and a positive definite symmetric 
matrix C, there exists a positive definite symmetric matrix B such that 


A'’B+BA=-C 
if and only if the zero solution of (7.5.1) is asymptotically stable. 


Proof. (=>) Let V be given by (7.5.2) for a positive definite symmetric matrix B. 
Substituting A? B + BA = —C into (7.5.3) gives V/(x) = —x’ Cx <0. Then by 
Theorem 7.1.3, the zero solution is AS. 


(<=) Given A, suppose C is symmetric positive definite matrix. Assume that x = 0 is 
AS and let ®(t) be the fundamental matrix of (7.5.1). Then by Theorem 4.2.3, there 
exist positive constants K and @ such that 


\|D(t) D7! (s)|| < Ke", ot ss. 
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In particular, ||e4/e~4*|| < Ke~“"-), t > s, or 
lars Kee. 2s: 


Now (e4)" — ef, and so the same above estimate holds for eA! (ts), Define 
lo.) 
B(t)h= / eA SDC eAC—D dg, 
t 


which exists since ||e4’e~4|| < Ke~“"—®), t > s. Differentiate both sides to get 


d ef” steep den °° AT (6-1) 7, AG) 
Wea eA / e SY Ce*S as [ e® SOC SY dsA 
t t 


= —C— A’ B(t)— BIt)A. 


Let u = s — t and rewrite the integral as 
ee dh 
B(t)= i: a "Cet du: 
0 


which does not depend on ¢ at all, that is, 4 Bit) = 0, or 
—C— A!’ B(t)— B(t)A=0. 


Finally, B is symmetric positive definite because C is. To see this, 


a = ("cet") du 

0 
oo T 

= (e7") Ce “ST du 
0 
oo Tr. 

=i e4 "CeA"du = B. 
0 


Thus B is symmetric. It remains to show that B is positive definite. Let x € IR” and 
consider the integrand. Then, for each t, we have 


xT eA tCeAty = (e4'x)"C(e4*x) = y Cy, 


and if x 4 0, then y ¥ 0; hence, as C is positive definite, y7 Cy > 0 for x 4 0. Thus 
B is positive definite. This completes the proof. 


In Theorem 5.1.4 we showed if Re(o(A)) < 0, then the zero solution of x’ = Ax 
is AS. Thus we may reformulate Theorem 7.5.1 in terms of the eigenvalues of the 
matrix A. 
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Theorem 7.5.2. Given ann x n matrix A and a positive definite symmetric matrix C, 
there exists a positive definite symmetric matrix B such that 


A'’B+BA=—C 
if and only if every eigenvalue of the matrix A has a negative real part. 


Example 7.24. Let us find a strict Lyapunov function to show that the zero solution 
of 


,_{-l 0 x] 

aly ye eee 
: ‘ —-1 O 
is asymptotically stable. Let A = 


> _ ) We will find a positive definite sym- 
metric matrix B such that A7B + BA =~—I. If B= 6 
A’ B+ BA =~—I implies that 


a then the relation 
be 


—2a+4b —4b+2c 
—4b + 2c —6c 


ll 
—s 


The above equations give a = 3, b= j5, andc 


= 


6 
_ 2 4, X1x2 x 

a4 6 6 

14 Xyx2 XR 
= put ¢ ti 


Thus V (x1, x2) is positive definite. On the other hand, after simple calculations, we 
arrive at 


Thus V is a strict Lyapunov function, and by Theorem 7.5.2, the zero solution of the 


system is AS. We could avoid verifying that V is a strict Lyapunov function and using 
Theorem 7.5.2 by finding a matrix B satisfying A’ B ++ BA = —I. 
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Remark 7.7. To ensure that the symmetric matrix B is positive definite, where B = 


b\ .. : ‘ F : 
(; it is sufficient for its coefficients to satisfy 
c 


a>0O, c>0, ac—b?>0. 


In the investigation of stability and boundedness for nonlinear non-autonomous 
systems, the effective approach is to study equations related in some way to the linear 
equations whose behavior is known to be covered by the known theory. We consider 
the perturbed nonlinear system 


x’ (t) = Ax(t) + g(t, x(t)), x(to.) = x0, t= to = 0, (7.5.5) 


where A is ann Xn constant matrix, and g : [0, 00) x R” — R” is a function contin- 
X1 81 (t, x) 


x2 2(t, x) 
uous int andx.Herex=]| | | and g(f,x)= ; . The perturbation term g 


Xn 8nlt, x) 
is assumed to be small in some sense. The next theorem pertains to the stability of 
the perturbed nonlinear system (7.5.5). 
By |x| we denote the Euclidean norm, and for an x n matrix C, by |C| we denote 
a compatible norm such that |Cx| < |C||x|. 


Theorem 7.5.3. Suppose there exists a positive definite symmetric matrix B such that 
A'’B+BA=-I (7.5.6) 


and 


im (8%)! 
IM: 


x30 |x| 


=0 uniformly int € [0.c0). (7.5.7) 
Then the zero solution of (7.5.5) is uniformly asymptotically stable. 
Proof. Write x for x(t) and define the function V by 
V =x! Bx. 
Using (7.5.6) and (7.5.7), along the solutions of (7.5.5) we have 
V! = (Ax + g(t,x))" B +x" B(Ax + g(t, x)) 
= x? (-I)x + 2x" Bg(t, x) 
<—|x)* + 2e11Bllg@, 2. 


Let ¢ > 0. Due to (7.5.7), we may choose ¢ sufficiently small so that for |x| < ¢, we 
have 


Hi 
21BiIg. 1 <>. 
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Thus 


2 2 
x x 
y’ < |x fe + | | — | | . 

2 2 
Since B is symmetric and positive definite, there are positive constants a and 6 such 
that 


a*x! x < V(x) < Brx' x, (7.5.8) 
from which we get 
1 a2 
-|x)’ < —gV@)s all 


As a consequence, 
Vs : V(x) 
-~ > V(x). 
=~ 5p? 


An integration of the above inequality from fp to ¢ yields 


1 


V(x(t)) < Vaoe 2” 


(t—t0) 


We have by (7.5.8) 


1 


o|x[2< V(x) <Viape 2, 


It follows that 


1 (t-to 


— ST (t—t) 
a? |x|? < xj Bxoe 2p? : 


) T — 
<|xq ||Bllxole 2°” 


For ¢ > 0 and |xo| < 6, we have 
1 1 6 1 
|x| < —(6|B|5)2 = —|B/? <e 
a a 


for 6 = Hence the zero solution is uniformly stable. Let 6 = 1 from the uni- 


ea 
[B|!/2° 
form stability, so that for |x(t)| = |xo| < 6, we need to show that |x(t)| < e for 
t>t+T(e). 
Set T(e) > —467Ln( 27). Then 


1/2 
re |B|l/ oo apt) 


1/2 1 
Z |B| oat) 


a 
<&. 


This completes the proof. 
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7.6 Exponential stability 


We return to the non-autonomous system 
x= fC), $60) =90, (7.6.1) 
where f € C((0, oo) x D, R"), and D Cc R” is an open set with 0 € D. 


Definition 7.6.1. We say that solutions of system (7.6.1) are bounded if any solution 
x(t, to, xo) of (7.6.1) satisfies 


Ix(¢,t0, x0)Il < C(Ix0l.t0) forall r > to, 


where C : Rt x Rt —> R? is a constant that depends on fg and xo. We say that 
solutions of system (7.6.1) are uniformly bounded if C is independent of fo. 


Definition 7.6.2. Suppose f(t,0) = 0. We say the zero solution of (7.6.1) is a- 
exponentially asymptotically stable if there exists a continuous function a(t) such 
that i a(s)ds — oo as t > oo and constants d and C € R® such that for any solu- 
tion x(t, fo, g) of (7.6.1), 


=f a(s)ds 


x(t, 0, Il SC(Igl, 40) (e )" for allt € [19, 00), 


The zero solution of (7.6.1) is said to be a-uniformly exponentially asymptotically 
stable if C is independent of fo. 


Definition 7.6.3. (Exponential stability) The zero solution of system (7.6.1) said to 
be exponentially stable if any solution x(t, to, xo) of (7.6.1) satisfies 


x(t, t0, x0) |S C(Ix0 toe for all t= to, 


where d is a positive constant, and C : [0, 00) x [0, 00) — [0, 00). The zero solution 
of (7.6.1) said to be uniformly exponentially stable if C is independent of fo. 


Theorem 7.6.1. Assume that D C R" and V : D > [0, 00) is a continuous function 
such that for all (t,x) € [0, 00) x D, 


WidlxlD S$ V@,x), (7.6.2) 
V'(t, x) < —a(t)V7(¢,x) + BO), (7.6.3) 
VEVE*)=VIE DA), (7.6.4) 


where a(t), y(t), and B(t) are nonnegative continuous functions, and p, q are posi- 
tive constants. Then all solutions of (7.6.1) that start in D satisfy 
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t 
Ilxll s Wy 1{V Go, xo)" fo 


: t 
it / (y(wau) + Bw) ee duh (7.6.5) 


Ht) 
for allt => to. 


In case g = 1, the proof is a simple application of the variation of parameters 
formula. On the other hand, if g 4 1, then the variation of parameters formula will 
not be of much help. Now we prove the theorem. 


Proof. For any initial time to > 0 and xg € D, let x(t, to, xo) be a solution of (7.6.1) 
with x,, = xo. Consider 


£ (ela v4, x) = [v’ eerie ole ff w(syds 
<(- a(t)V4 (t,x) + Bt) + a(t) V(t, x) )elnaores 
= (ouvir, x) — V4(t, x)) + Bi) )e Sin tds 
= (aro - pin))el aay 
Integrating both sides from fo to t, we obtain, for t € [f9, 00), 


t 
Vit, vel ate 


< V(to, xo) 
t u 
+f (yaw) + B(u)) ehg OF ary. (7.6.6) 
to 
It follows that 


: t 
Vine Viipe 2 +f 


i) 


(yaw) + Bw) ela du 
for all t € [to, 00). Inequality (7.6.2) implies that 


: t 
xO W~'[V eo. ame 2" + f 


to 


(yoru) + B(u)) eLe@4® duh 


for all t > to. This concludes the proof. 


It is easy to see that if Wy (||x||) = ||x||? for some positive p, then inequality 
(7.6.5) becomes 


t 
IIxll s [V(o, zope 00 


t 1/ 
+ i (y wat) + Bw) e Suats)ds du} te (7.6.7) 
i) 
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Corollary 7.2. Assume that the hypotheses of Theorem 7.6.1 hold. 


(i) If 
t t 
. (yo) + Bw) e Weds gy < Mt > to >0, (7.6.8) 
to 
or some positive constant M, then all solutions of (7.6.1) are uniformly bounded. 
p y 
(ii) If 
t u 
i (yaw) + Bw) elo" du <M (7.6.9) 
to 
for some positive constant M, and 
t 
/ a(s)ds > 00 as t> oo forall t> to, (7.6.10) 
to 
then every solution of solution (7.6.1) decays a-exponentially asymptotically to zero 
with d = 1/p. 
(iii) If 


f(t,0) =0 


and (7.6.9) holds for q positive constant a, then the zero solution of (7.6.1) is expo- 
nentially stable. 


Proof. Let x be a solution to (7.6.1) that starts in D for all t > to > 0. Consequently, 
the proof of (i) is an immediate consequence of inequality (7.6.7). For the proof 
of (ii), we consider the inequality from the proof of Theorem 7.6. 1 


a(s)ds 


t t 1 
Vit, x;)el"0 < V(t, x0) +f (vow) + B(u)) olig %s)ds ay 
0) 


for all t € [to, 00). This yields 
J fi a(s)ds -fi a(s)ds 
Vita) < [Vo x0) + (yiaru) + Bw) 0° dulefn2" 
1 
for all t € [fp, c0). Using Wj (||x||) = ||x||?, we have 


ge a a(s)ds 


t u 
inl = [V¢to.x0) +f (vanau) + 0) ef" dul] | (76.11) 
to 


The proof of (iii) is an immediate consequence of inequality (7.6.11). This completes 
the proof. 


Remark 7.8. If f(t, 0) 40 and (7.6.9) and (7.6.10) hold, then all solutions of (7.6.1) 
decay exponentially to zero. 
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Example 7.25. For a(t), b(t), h(t) = 0, consider the scalar differential equation 
7 
x(t)= —(a(t) + gr + b(t)x3 (t) +h(t) t>to>0, (7.6.12) 
with initial condition x(t) = x9 € R. Let V(t,x) = x?. Then along any solution 
x := x(t) of (7.6.12), we have 
V(t, x) = 2xx’ 


| 
=-2(a(t) + a)" + 2b(t)x4/? + 2xh(t) 
7 
<—2(a(t) + rua Op Ox? a? Ie: 
To further simplify V’(t, x), we use Young’s inequality, which says for any two non- 
negative real numbers w and z, we have 
f 1 1 
w z 
< ith =: 
WZ< : + r; wl a 
Thus for e = 3/2 and f = 3, we obtain 


1 Gary A 2 
2Ib(t)|x4/3 < 2[sbor ap |= Be + SIO. 
As aresult, we have 
V' (t,x) < —2a(t)x? + 5b) + h(t). (7.6.13) 
It follows that 
V'(t,x) < —a(t)x? + A(t), (7.6.14) 


where a(t) = 2a(t) and B(t) = 2b (t) + h?(t). We can easily check that conditions 
(7.6.2)-(7.6.4) of Theorem 7.6.1 are satisfied with W, (|x|) = x’, q=2, and y = 0. 
Next, we choose some convenient values for our variables. 

Let a(t) = 5, b(t) = 13, and h(t) =1!/2. Then a(t) =1, A(t) = 31, and (7.6.14) 
becomes V’(t, x) < —tx? + 3t. We note that 


t 


t : 
a(u) + B(u) e Su a(s)ds du= 5 ue™ Ju sds du 
(y Bw) : 
to 


i) 


5) 
< ae 
~ 3 
for all t > t9 > 0. Thus condition (7.6.8) holds. By Corollary 7.2 all solutions of 
t 7 
X(N) =—(5 + gx + r3x3() +1", x9) =x0, t= %>0, (7.6.15) 


are uniformly bounded. 
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On the other hand, if we take a(t) = 1/2, b(t) = e~“'"/7, and h(t) = 0, where 
«1 > 1, then we have a(t) = 1, B(t) = fenK and 


t u t9 u 
/ (veiw) + Bw))eln du -| qo ee 48 du 
to 


0) 


eto —«1) 


Pees ees 
~ 3(kq, — 1) 


for all t > to > 0. Hence condition (7.6.9) is satisfied. Finally, (7.6.11) gives the in- 
equality 

2 to(1—1)) ,«1 (to) 

t)| < —— 
|x( NS 0+ 30 1? Je 
2 
2 

< ee 
(0+ = 


) eki(t—to) ; 
from which we arrive at the uniform exponential stability of the zero solution of 


5 K 
x") =— 5x0) + e-4F'x3(t), x(f) =x0, t> 120. 


7.7 Exercises 


Exercise 7.1. Use Lyapunov function to investigate the stability of the origin for each 
of the following systems and compare with the linearization method: 

(a)x’=y, y= —x. 

(b) x’ = —xy?, y’ = 3yx?. 

(c) x’ = y —2x, y’ =2x —y— x3. 
(d) x’ =x+3y, y’ =2x. 

(e)x/ =x? +y,y =x+y?. 
(\x’=y,y=—-x-y—x, 

Exercise 7.2. Find the two equilibrium solutions and use Lyapunov functions to 
investigate their stability of 


xi =y-x’, y axe, 


Exercise 7.3. Consider the planar system 


x= =e, 


yl =—y— yx? 


Examine the stability of the origin using: 
(a) Theorem 6.2.1, 
(b) a Lyapunov function. 
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Exercise 7.4. Consider the planar system 


x’ =ax(x+y)— xy, 
y’ =ay(x+y)4x7y’. 


Examine the stability of the origin for different values of a using: 
(a) a Lyapunov function, 
(b) the linearization method. 


Exercise 7.5. Put the differential equation 
4G) +e tae DS0 


into a system and find its two equilibrium solutions and examine their stability using: 
(a) a Lyapunov function, 
(b) the linearization method. 


Exercise 7.6. Use the indicated Lyapunov function V and Theorem 7.1.4 to show 
that the origin is asymptotically stable. Show that all solutions tend to the origin as 
t> ©. 

(a) x’ =2y, y' = —3x — 3y?, V = 3x2 +2y?. 

(b) x’ = —x + 6y, y’ = —x — 2y, V =x? + 2y?. 

(c) x’ = —2x — y, yw =6x —y, V=2x7 + y’. 

(d) x’ =y, y' =—x?y— x3, Vax442y?. 


Exercise 7.7. Study the stability of the origin for the planar system 


x’=x(y—1), 


x2 


14 x2’ 


i 


Y= 


by considering the Lyapunov function V(x, y) = Ln(1 + x”) + y?. 


Exercise 7.8. Use a Lyapunov function to show the existence of a stable limit cycle 
for the system 


x’ =ytx(ur—x?—y’), yi =—x + yu? —x? — y’) 


for u #0. 


Exercise 7.9. Consider the planar system 


x’=x+gi(x,y), y =—yt+ go(x,y), 


where g; and go are continuous on a subset D of R? that contains (0, 0). Suppose 
that for a positive constant k, 


lIgill < k(x? + y”),i = 1,2, 


with 21(0, 0) = g2(0, 0) = 0. Use Theorem 7.1.6 to show that the origin is unstable. 
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Exercise 7.10. Consider the second-order differential equation 
x” + g(x) =0, 


where g is continuously differentiable, g(0) = 0, and xg(x) > 0. Write the equation 
as a system and use a Lyapunov function to show that its zero solution is stable. 


Exercise 7.11. Consider the second-order differential equation 
x" + f(x)x' + g(x) =0, 


where f(x) and g(x) are even and odd polynomials, respectively. 
(a) Show that the equation is equivalent to the system 


e = y= FC), 9 =e), 
where F(x) = [5 Ff (s)ds. 


(b) Let G(x) = i g(s)ds and suppose there are positive constants a and 6 such that 


0 
g(x) F(x) > 0 for 0 < |x| < @ and G(x) < B for |x| <a. 
Show that 


y? 
V@, y= +6@) 


is a Lyapunov function in the region A = {a, B € R: |x| <a, y* < f} and that the 
origin is asymptotically stable. 


Exercise 7.12. Consider the predator-prey model with carrying capacity 
x’ =x[a—dx—by], y’ =y[-c+kx], 


where x(t) and y(t) are the numbers of preys and predators at time ft, respectively, 
with positive constants a, b, c, d, and k. 

(a) Find the equilibrium point (x*, y*) located in the first quadrant. 

(b) Use the transformation 


x y 
u = Ln(—) and v = Ln(—) 
x* yr 


to obtain a system in (u, v). 
(c) Show that 


Vu, v) =kx*(e" —u) + by*(e” — v) — kx* — by* 
is a Lyapunov function and that the equilibrium solution (x*, y*) is stable. 


Exercise 7.13. Prove Theorem 7.1.7. 
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Exercise 7.14. Consider the second-order differential equation 
xy (w+ vx)x’ +x+x° =0 


(a) If v = 0 and yu > 0, then show that the zero solution is asymptotically stable. 
(b) If 7. = O and v > 0, then show that the zero solution is stable using an appropriate 
Lyapunov function. 


Exercise 7.15. Consider the planar system 
x! = (x —by)(x* +y?- 1), 
y=(ax+y)@?+y’—D. 
Show that the origin is stable if a,b > 0. 
Exercise 7.16. Show that the origin is unstable for the planar system 
x =x4+y, 
ysx-ytxy. 


Exercise 7.17. Suppose f is continuously differentiable and consider the planar sys- 
tem 


x’ =y—xf(x,y), 
y' =—-x— yf (x,y). 


Show that the origin is asymptotically stable if f(x,y) > 0 and unstable if 
f(x,y) <9. 


Exercise 7.18. Let V =x? + y* and consider the system 
x'=(x-y)Q@’?+y’-1), 
y= @ty@?+y?—D. 

Show that the origin is asymptotically stable and find the region of attraction. 


Exercise 7.19. Let V = x* + y* and consider the system 


/ 


x Sp Oy? 5 

y=-yty’. 
Show that the origin is asymptotically stable and find the region of attraction. 
Exercise 7.20. Let V = x? + y* and consider the system 

x’ =-x+2y?—2y%4, 

y’ =-x—-—y+xy. 


Show that the origin is globally asymptotically stable. 
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Exercise 7.21. Let V = ax?” + by”, a, b > 0 and consider the system 
x =—3x3 — y, 
y= ee Dy 


Determine the values of a, b, m, andn, where m and n are positive integers, such that 
the origin is globally asymptotically stable. 


Exercise 7.22. Decide if the functions given below are radially unbounded or not. 


(a) 
V (x1, x2) = (41 — x2)°. 
(b) 
2,12 
x7 +x. 
V (x1, 2) = —L 5 + 1 — x2)”. 
1+ x7 +x5 


Exercise 7.23. Consider the equation 
”" / 3 
yo By yy =O, Ba 0, 


which is a particular case of mass-spring nonlinear damper. 
(a) Use the transformation v = y’ and obtain a corresponding system in y and v. 
(b) Show that 
24,4 2 
yoty U 
V(y,v) = + — 
(y, v) 5 5 


is a Lyapunov function. 
(c) Decide whether the origin is stable or asymptotically stable. 


Exercise 7.24. Consider the non-autonomous system 
x’ =—x — g(t)y, 
yox-y, 
where g(f) is continuously differentiable and, for positive constants k1, k2, satisfies 


ky < g(t) <ko and g’(t) < g(t) 


for all t > 0. Use a Lyapunov function to show that the zero solution is uniformly 
stable. 


Exercise 7.25. Consider the scalar non-autonomous differential equation 


x’ =—(1+80))s°, 
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where g(f) is continuous, and 
g(t)>0 forall t>0. 


Use a Lyapunov function to show that the zero solution is uniformly asymptotically 
stable. 


Exercise 7.26. Let D = {x € R” : |x| < 6} for 5 > 0, and let V(t, x) : [0,00) x D> 
[0, oo) be a continuously differentiable function satisfying 


V(t, 0) =0, 
Wi(Ix|) < VG, x) < Wa([xI), 
and 
V(t, x) < —W3(V(t, x)) forall t>0, |x| <6. 
Show that the zero solution of (7.1.17) is uniformly asymptotically stable. 


Exercise 7.27. Put the scalar equation 


into a system and find a function that satisfies the requirements of Theorem 7.3.1. 
Exercise 7.28. Write the scalar equation 
x" + f(x’) + g(x) =0 
as a system. Assume that 
xf(x')>0, x'40, and xg(x) >0, x 40. 
Use Theorem 7.3.1 to show that the origin is asymptotically stable. 


Exercise 7.29. Use Exercise 7.28 to show that the zero solutions of given differential 
equations are asymptotically stable. 


(a) x" +x'|x/|+x—% =0. 
(b) x” + (x’)3 +. x9 — x4 sin?(x) = 0. 


Exercise 7.30. Consider the system 


= —x1 + g(Xx2), 


x 
x9 = —X2 +h(x), 


where g and /: are continuous and satisfy 


Ig@)| < |ul/2, |h(u)| < |ul/2. 


Use the Lyapunov function V (x1, x2) = 5 (x7 + x) to show that the origin is uni- 
formly exponentially stable. 


Copyright Elsevier 2022 


—CCCCC“‘(LUUOCts‘(‘(UU'C‘#A”L""_OCC‘(‘a‘“#™ E<=_o 


7.7 Exercises 283 


0 


Exercise 7.31. Let C=J and A= [2 


=) Find a symmetric matrix B such 
that A7B+ BA=—I. 


Exercise 7.32. Let B be chosen from Exercise 7.31 and set V = x’ Bx. Show that 
V is an autonomous Lyapunov function in some open set D containing x = 0 for the 


system 
x, =x2+ filt,x), 
x5 = —2x1 — 3x2 + f(t, x), 
where 
Uf 
Wil _g giao 
Ixl>0 |x| 
uniformly for t € [0, co) x B,(0). Then find a wedge W such that V’(x) < —W(|x|) 
on D. 


Exercise 7.33. Consider the pendulum of Example 7.21 and define the function 
_ 8 lf 
V(x1, x2) = al _ cos(x1)) + 5% Bx 


with positive definite matrix B that is to be found. 
Hint: See Remark 7.7 and then compute V’ along the solutions. Pick the entries of B 
to ensure that V is a strict Lyapunov function on the set D — {(0, 0)}. 


Exercise 7.34. Use Theorem 7.4.2 to show that the zero solution is asymptotically 
stable for 


g Sx 4+ ay y= —2xy’. 
Hint: See Example 7.22. 
Exercise 7.35. (Harmonic oscillator) Let 
x” + sin(x) = 0. 


(a) Can you prove the stability of the origin using linearization? Use an appropriate 
Lyapunov function to show that the origin is a stable equilibrium solution. 
(b) Add the damping term 


x" + ex’ + sin(x) = 0. 


Study the stability of the origin for e > 0. 


Exercise 7.36. Let x(t) = (x1 (t), x2(t))? € R? and consider 


X(t) = x2(t) — x1 (a1), 
x5(t) = —x1(t) — x2(t)|x2(t)| 
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with initial condition x(to) = x0 € R?. Set D = {(x1, x) € R?: x7 +45 < =) Let 
V :[0,00) x D — [0, oo) be given by V(t, x) = 3(x7 + x3). Show that: 
(a) 
V' (t,x) < -2V7(, x); 
(b) 


4 
Vit,x) — Vi (t,x) =Vit,x) — V7 0,2) < a 


for (x1, x2) € D. 

(c) Refer to a specific theorem in the text to conclude that the zero solution is uni- 
formly exponentially stable for any xo € D. 

(d) Explain why linearization around the origin cannot be used here. 

Hint: Use the inequality 


bye ae be 
Great 47 bbls i 
2 2° 9 


Exercise 7.37. Let x(t) = (x1(t), x2(t))’ € R? and consider 


x4 (t)=x2—- g(t)xi(x7 + x2), 


x4(t) = —x1 — g(t)x2(xp + x5) 


with initial condition x(t) = x9 € R*, where g(t) is continuously differentiable and 
bounded, and g(t) > k > 0 for all t > 0. Set D = {(x1, x2) € R*: x7 + x} < 1}. Let 
V :[0, 00) x D — [0, 00) be given by V(t, x) = (x? + x3). Show that the hypothe- 
ses of Theorem 7.6.1 are satisfied for (x,, x2) € D and conclude that the zero solution 
is uniformly exponentially stable for any xo € D. 


Exercise 7.38. Consider 


x4 (t) = x2 +213, 


X(t) = —x1 — x2 + x2%3, 
x4(t) = —x? _ . 


Use Theorem 7.4.2 to show that 
x(t), x2(t) > 0 as too, and x3(t) > c as t> oO, 


for some constant c. 


Exercise 7.39. Repeat Example 7.24 for the system 
,_{-l1 0 xX] 
x= ( i 2) lee)? t>0. 
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Exercise 7.40. Consider the SIR epidemic model of Section 6.3 and let 
T={(S,1I):S>0,1>0, S+1 <I}. 


Define the function V on T by 


S I 
V(s,1)=S-—S* Sint! r* Ln(;3)- 
(a) Show that along the solutions we have 


(S — S*)? 


VS, I) <- 
(S$, <—p 6 


(b) Show that V is positive definite on T. 
Hint: Clearly, V(S*, /*) = 0. To show that V(S, 7) > 0 for (S, 1) 4 (S*, 1*), con- 
sider the function 


x 
f@) =x —x* —x*La(—), O<x<1,0<x* <1 
x 
and show it has a minimum of zero at x* and f(x) > 0 for x #~x*. 
(c) Use Theorem 7.4.2 to conclude that (S*, 7*) is asymptotically stable. 


Exercise 7.41. Consider the Lorenz system 


x'(t)= p(y —x), 
y (t)=rx—y — xz, 

z@) Say — bz, 
where p, r, and b are positive constants. 
1) Show that, for 0 <r < 1, the origin (0, 0, 0) is the only equilibrium solution. 
2) Let 

1 
VQy2= (x + py’ + pz’). 
2p 


Show that the origin (0, 0, 0) is asymptotically stable for 0 <r < 1. 
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CHAPTER 


Delay differential 
equations 


This chapter is introductory to the study of delay differential equations. We will 
touch on the existence and uniqueness of solutions and stability using the Lya- 
punov method. Toward the end of the chapter, we use the fixed point theory on 
Banach spaces developed in Chapter 2 to deduce boundedness and stability results 
for neutral delay differential equations. We end the chapter by utilizing Lyapunov 
functionals and obtain the exponential stability for totally nonlinear finite delay 
integro-differential equations. 


8.1 Introduction 


Delay differential equations are a type of equation in which the derivative of the un- 
known function at a certain time is given in terms of the values of the function at 
previous times. In the previous seven chapters, we considered finite-dimensional dif- 
ferential systems, where the state at any time can be obtained from a finite set of 
values. On the other hand, delay differential equations are infinite-dimensional sys- 
tems. As a consequence, delay differential equations present us with some difficulties 
when we analyze them. Nevertheless, some known theories for differential equations 
can be extended to cover delay differential equations. 
For the moment, we consider the scalar delay differential equation 


x’ = f(t, x(t), x(t —7)), (8.1.1) 


where tT is a positive constant known as the delay. If we set t = 0 in (8.1.1), then 
we must know the value of the dependent variable x at s, where —t <s <0, that is, 
we need to define an initial function g : [—t,0] — R. In other words, the initial 
function g gives the behavior of the system prior to time 0 (assuming that we start at 
time t = 0). In general, for system (8.1.1) to be well posed, we must specify an initial 
function and work with the delay system 


x'=f(t,x@,x@—-1)), OS <t<ty, (8.1.2) 


x(s)=9(s), —T<5<t) <0, 


where f : [fo, tf] x R2 — R. Note that system (8.1.2) is referred to as a delay differ- 
ential equation with finite delay. 
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Initial 
function 
fo(t) A(t) A(t) 
ss: :00O”—_—_ __—__ SE 
—T 0 Tv 2t t 
FIGURE 8.1 


The effect of the initial function and the delay and the solution space. 


Definition 8.1.1. We say that x : [fo — t,t] — R is a solution of (8.1.2) if it is 
continuous and satisfies (8.1.2) for f9 <t < ty and x(s) = (s), —t <5 < . If every 
two solutions of (8.1.2) agree with each other as far as both are defined, then the 
solution is said to be unique. 


We may think of the solution of (8.1.2) as a mapping from functions on the inter- 
val [t — t, t] into functions on the interval [t, t + tT]. In other words, the solutions can 
be thought of as a sequence of functions fo(t), fi (t), fo(t), ... defined over intervals 
of length t. The points t = jt, 7 =0, 1,2,..., where the solution segments meet are 
called knots. Fig. 8.1 illustrates this mapping. 

It is to be understood that x’(to) is the right-hand derivative of x at to. In most 
cases the solution is not differentiable at t = fo as seen in Fig. 8.1. In the case of 
differential equations, we only have to give an initial condition at a single point, 
known as the initial time. 

For the delay system (8.1.2), we had to specify an initial function on the whole 
interval [—T, fo], to < 0. The system inherits being infinite-dimensional from the fact 
that the initial function takes infinitely many values at infinitely many points in the 
interval [—T, fo]. 

There are different types of delay differential equations: 


X= fE40,40—- 1) tC —- Gy) Us srsiy, (8.1.3) 


x(s)=Q(s), —TX5<t <0, 


where t = max{t;, 1 < j < m}. We can try to solve (8.1.3) forO <9 <t<tp +r, 
where r = min{t;, 1 < j < m}. System (8.1.3) is known as a differential equation 
with multiple delays. For (8.1.3), the initial function g : [—T, top] ~ R”, to < 0. On 
the other hand, if a(t) is a continuous function with a : [0, 00) > (—ov, oo), then the 
system 
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t 
x =anx( + | f(s, x(s))ds, OXt<tX<ty, (8.1.4) 


x(s) =9(s), —CO<s<t <0 


is referred to as a Volterra integro-differential equation with infinite delay. System 
(8.1.4) is called a Volterra integro-differential equation with finite delay if the lower 
limit of integration is t — t, where t > 0, instead of —oo. In this case the initial func- 
tion is the same as in (8.1.2). Others may refer to it as a Volterra integro-differential 
equation with distributed delay. Finally, if the delay t of system (8.1.2) depends on 
time, then the system is referred to as a delay differential equation with time-varying 
delay or functional delay. 


8.2 Method of steps 


The Method of steps can be used as a tool for simple delay differential equations to 
obtain a solution, given some initial data. The method of steps is best illustrated by 
looking at an example. 


Example 8.1. (Method of steps) Consider the delay problem 


x S=2 = 1, 226, (8.2.1) 


x(s) =y(s)=10, -—l<s <0. 
We will try to piece together the solution on [0, 3]. 


Step 1. In this step, we find the solution on 0 <t < 1. For 0 <t < 1, we have 
—1<+t-—1<0, and hence x(t — 1) = 10. Thus from (8.2.1) we obtain 


dx 
—=-_10, 
dt 
which has the solution 
t 
x(t) = x(0) +f (—10)du = 10— 10f. 
0 
Step 2. Now we find the solution on | <t <2. For 1 <t < 2, we have 0< 


t — 1 < 1, and hence x(t — 1) = 10 — 10(t — 1), where we have made use of the 
solution from Step 1. Thus from (8.2.1) we obtain 


x 
— =-—10+ 10¢¢ — 1), 
ai + 10@ — 1) 
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which has the solution 


t 
x(t) =x(1) +f [—10+ 10(u — 1)]du 
1 
=0-10u+5(u—1)?|} 
=—10¢ =1)4+5¢ =17, 
where we have used x(1) = 0 from the solution in Step 1. 


Step 3. Now we find the solution on 2 < t < 3. For 2 <t < 3, we have 1 < 
t—1 <2, and hence x(t — 1) = —10(t —2) +5(t —2), where we utilized the solution 
from Step 2. Thus from (8.2.1) we obtain 


4% _ 10(¢ 2) —5¢ 2), 
dt 


which has the solution 


t 
x(t)=x(2)+ / [10(u — 2) —S(@ — 2)*|du 
1 
2_35 3 
=-—5+5(t —2) z(t 2)”, 
where we have used x(2) = —5 from the solution in Step 2. 


In Example 8.1 
lim x’(t)= lim g’(t) = 10, 
t>0- t>0- 
and 
lim x’(t)= lim (—10¢ + 10)’ = —10. 
t>0t t>0t 


Therefore the solution is not differentiable at the initial time to = 0. 


Now we consider the basic delay differential equation 
x= ft, x(t—1)), t20, x)=), -t<5 <0. (8.2.2) 


If f and gy are continuous on R? and R, respectively, then a unique solution defined 
by 


t 
x(t) = g(0) +f f(s, g(s — t))ds (8.2.3) 


exists for 0 < t < t. We may argue using the method of steps to show that a unique 
solution exists for all tf > 0, which is valid regardless of how small the delay T is. 
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Note that if t = 0, then our delay problem becomes an ordinary differential equation. 
Consider the delay problem 


x'=x*(t—T1), t>0, x(s)=1, —t<s <0. (8.2.4) 


Using the method of steps, we may find a unique solution. However, if we set tT = 0 
in (8.2.4) with x(0) = 1, then the solution of x’ = x(t), t > 0, exists only for t < 1. 
This example should cement that the existence of solutions in finite delay differential 
equations is much easier to obtain, unlike ordinary differential equations. 


Example 8.2. Consider the predator-prey model with carrying capacity 
x! =ax —dx? — bxy, y =-cy+kxy, 


where x(t) and y(t) are the numbers of preys and predators at time t, respectively, 
with positive constants a,b,c,d, and k. The term kxy represents the predator’s 
utilization of the prey it captures. Hence there is certainly a delay, say r > 0. As 
a consequence, we have the predator-prey delay system 


/ 


x’ =ax — dx? — bxy, y =-—cy+kx(t—r)y(t—r). 


Suppose we are given an initial continuous function (¢) (t), 62(t)) with x(s) = ¢1(s), 
y(s) = d2(s), —r < s <0. Then by integrating the linear equation 


y =-cy+kpi(t—r)do(t—r), O<t <r, 


we arrive at the explicit solution of y given by y(t) := ¢(t). Substituting y back into 
the equation with x’ gives the homogeneous Bernoulli differential equation 


x’ = ax — dx? — bx¢(t), x(0) = ¢1(0), (8.2.5) 


which can be easily solved using techniques from basic differential equations. To see 
this, we let c(t) = a — bf(t) and v= x—!. Then we have the resulting differential 
equation in v, 


v(t)+c(thu=b. 


Multiplying by the integrating factor, integrating, and simplifying, we arrive at the 
solution 


$1(0) 
Zh c(s)ds + bd (0) i en C c(s)ds ty 


x(t) = 


where we have used v = x~!. 
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8.3 Existence and uniqueness 


We examine the existence and uniqueness of systems with constant delays since they 
are involved in many applications. For simplicity of notation, we assume that fo = 0. 
This should not cause any difficulties or take away from the meaning of the problem. 

Let x be ann x 1 vector-valued function, let D be an open set in R”, and let 
f be defined on [0, co) x D”. Define an initial function g : [—t, 0] — R”, where 
Tt =max{t;, |< j < m}. Letr = min{t;, 1 < j < m} > 0 and consider the system 
with multiple constant delays 


x’ = f(t,x(t—T1),...,x(t—t)), O<t<ty, (8.3.1) 


x(s)=(s), —tT<s<0. (8.3.2) 


We may rename the delays so that they are listed in an increasing order so that tT = T,, 
andr =T: 


O<T, <1 <-+++ < Typ. 


Definition 8.3.1. We say that x : [f9 — t, tg] > D is a solution of (8.3.1)-(8.3.2), 
where 0 < tg < ff, if it is continuous and satisfies (8.3.1) for 0 <t < tg, and x(s) = 
g(s), —t <s <0. The solution of (8.3.1)-(8.3.2) is said to be unique if every two 
solutions agree with each other as far as both are defined. 


Theorem 8.3.1. Let f be continuous on [0,tf) x D™, and let g :[—t,0] > D 
be continuous on [—tT,0]. Then system (8.3.1)-(8.3.2) has a unique solution x on 
[—t, B1), where 0 < By <tr. Moreover, if B| < ty, then x(t) approaches the bound- 
ary of Das t > Bj. 


Proof. Let t € [0, r]. Then every solution resides over the domain of the initial func- 
tion, that is, 


x’ = f(t, p(t —11),..., p(t — tm)) 


with x (0) = g(0). An integration from 0 to ¢ gives 


t 
x(t) = (0) +f FU, oC —1),..., 00 — tr) dl, 


which uniquely defines x(t) for 0 < t <r, provided that r < ty and x(t) remains 
in D. Now that we know x(t) on [—t, 7], we may continue in this fashion on [r, 27] 
as long as 2r < t¢ and x(t) remains in D. We continue with this method of steps until 
we reach tf or until x(t) reaches the boundary of D. This completes the proof. 


Remark 8.1. Suppose at least one of the t; = 0, j = 1,2,...,m. To be specific, 
suppose only t; = 0 and the rest of the delays are distinct and greater than zero. Then 
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system (8.3.1) will include a differential equation. In this case proving the existence 
and uniqueness requires a Lipschitz condition on f of the form 


Lf (t, Vet), V2). «+> Ym) — Ft. Zs ZQ)s +++ Zim) 1S Klyay —Zzayl (8.3.3) 
for y(j), 27) € IR" and positive constant K. 


Corollary 8.1. (Uniqueness) In addition to the hypotheses of Theorem 8.3.1, assume 
(8.3.3). Then (8.3.1)-(8.3.2) has at most one solution on any interval [—t, 81), where 
0<fpi< tf. 


Proof. The case r > 0 is already covered by Theorem 8.3.1, so we let r = 0. Then 
for t € [0, to], 


if = f(t, x(t), gt = T2), ae OG = Tm)) 


with x(0) = g(0). Then by Theorem 2.2.1, it has at most one solution. We may repeat 
the above process for ¢ € [t2, 2t2], for t2 < tr. We keep repeating the process until 
we reach t¢. This completes the proof. 


Recall our remark in Chapter 3 that a multivariable function f satisfies a Lipschitz 
condition on some region if all its first partial derivatives are continuous on that re- 
gion. We have the following example. 


Example 8.3. Consider the sun flower model 
u(t) + bu’ (t) + esinu(t —r) =0, t>0, 


where b,c, and r are positive constants. Using the transformation xj =u, x2 =u’, 
we atrive at the system 


a=, 


x5(t) =-—c sinx,(t —r) — bx2. 


Therefore 


Y(1j2 
Ft vonyo)=( 3 
G22) —csin y(2)1 — byay2 
Clearly, f is continuous, and so are the partial derivatives 
OA Pg, PRS 
dyyr Yaa AYaya 


Thus by Corollary 8.1, given any continuous function y : [—r, 0] > R?, the delay 
system has at most one solution on [—r, 6) for any 6; > 0. 
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8.4 Stability using Lyapunov functions 


In this section, we consider general forms of delay differential equations that fall into 
the category of functional delay differential equations. A functional delay differential 
equation is a delay differential equation where the unknowns are functions. We will 
adopt the following notation. For any r > 0, any continuous function x(u) defined on 
—r<u<A,A>O0, and any fixed t, 0 <t < A, by x; we denote the function x;(s) = 
x(t+s), —r <s <0, that is, x :[a, b] > R” is continuous and is the segment of the 
function x(s) defined by letting s range in the interval t — r < s < t. We consider the 
functional delay differential equation 


x'(t) = F(t, x;), t >t. (8.4.1) 


We assume that F is continuous in both arguments and that F : R x C > R”, where C 
is the set of continuous functions ¢ : [—a, 0] > R”, a > 0. If t9 = —ow, then t > fg 
means that ¢ > fg. Let 


C(t) ={¢:[t—a,t] > R"}. 


It is to be understood that C(t) is C for t = 0. Also, ¢; denotes @ € C(t), and 
Ilé;|| = max |@(t)|, where | - | is a convenient norm on R”. A solution is denoted 
t—a<s<t 


by x(to, PI) and its value by x(t, to, Gio) or, if there is no confusion, by x (fo, @) and 


x(t, to, @). 
Definition 8.4.1. Let x(t) = 0 be a solution of (8.4.1). 


(a) The zero solution of (8.4.1) is stable if for all e > 0 and t, > fg, there exists 6 > 0 
such that [6 € C(t), ||¢|| < 6,¢ >t] imply that |x(t,4,)| <e. 


(b) The zero solution of (8.4.1) is uniformly stable if it is stable and if 6 is independent 
of ft; > fo. 


(c) The zero solution of (8.4.1) is asymptotically stable if it is stable and if for each 
t; > to, there is n > 0 such that [@ € C(t), ||@|| < 1] imply that |x(t, 4, 6)| > 0 as 
t — oo. Note that if this is true for every 7 > 0, then x = 0 is asymptotically stable 
in the large or globally asymptotically stable. 


(d) The zero solution of (8.4.1) is uniformly asymptotically stable if it is uniformly 
stable and if there is 7 > 0 such that for each y > 0, there exists S > 0 such that 
[th > t,6€ C(t), \lOll < 7,t = t; + S] imply that |x(¢, 1, @)| < y. We also note 
that if this is true for every 7 > 0, then x = 0 is uniformly asymptotically stable in 
the large. 


Let W; : [0, 00) — [0, co) be continuous with W; (0) = 0, W;(r) strictly increas- 
ing, and W;(r) > coasr > oc, i = 1, 2,3. 


Consider the totally nonlinear differential equation with bounded delay 


x! (t) = —ax3(t) + bx3(t —r), t > to > 0, 
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where a, b, and r are positive constants. Consider the Lyapunov-type functional 
iL 
Von) = le) +b | Ix (s)Ids. 
t-r 


Let a > b. Then along the solutions we have 
/ xy 3 3 
Vian= ie b|x"(t —r)| + bx") 


= at ax*(0) + bx*(t—r)) — ble =r) + bb 


< -a)x3(1)| + bP — 1) — bP G1) + bP OI 
=[—a +b]|x*| <0. (8.4.2) 


Let t} € R, g € C(t), and x(t) = x(t, 1, g). Using the fact that |x(t)| < V(x;) and 
integrating (8.4.2) from t; — r to ft yield 


Ix(t)| < Vr) < Vr) 
ty 


= oan +b f 19(s)|ds 


t-r 
< (1+ br)Ilgn I. (8.4.3) 
1/3 
Suppose a > b, let e€ > 0, and choose 6 = (Ge) . Then for ||@;,|| < 6, from 
(8.4.3) we have 
€ 1/33 
nist-+oal( cea)" P =e 
Ino < (+00) [(— 
and the zero solution is uniformly stable. Note that stability is independent of the size 
of the delay r. 


Integrate (8.4.2) for 0 to t and obtain V(x;) — V(go) < — i, |x(s)|3ds, which 
implies that 


t 
/ Ix(s)Pds < V(go) — Vr) < V(go) < 00 


for all t > 0. Hence x3(t) € L![0, 00). 


Next, we prove parallel theorems to Theorems 7.1.8—7.1.11 concerning system 
(8.4.1). 


Theorem 8.4.1. Let D > 0. Suppose V(t, W;) is a scalar functional continuous in w 
and locally Lipschitz in yy when t => to and Wy € C(t) with ||Wr|| < D. Suppose also 
that V(t, 0) =0 and 


Wil¥@) < VG, Ww). (8.4.4) 
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(a) If 
V'(t, Wt) <0 for ty <t <0o and ||W;|| < D, (8.4.5) 


then the zero solution of (8.4.1) is stable. 
(b) [fin addition to (a), 


Vit, Wr) < Wally), (8.4.6) 


then the zero solution of (8.4.1) is uniformly stable. 
(c) If there is M > 0 such that | F(t, W)| < M for to < t < co and ||y|| < D, and if 


V'(t, Wi) S —Wallw |), (8.4.7) 


then the zero solution of (8.4.1) is asymptotically stable. 


Proof. Let ¢ > 0 be such that e < D. Let t; > fo. Since V is continuous and 
V(t, 0) = 0, there exists 6 > 0 such that @ € C(t,) with ||@;,|| < 6 implies that 
Viti, dy) < Wi(e). By condition (8.4.5) we have 


Wi(\x(t, t1, br) |) < Vt, x(t,t, br) = Viti, bn) 
< Wi(é), 


from which it follows that 


Ix(t.t1, bn) < Wy! (Wile) =e. 


This concludes the proof of (a). 
As for the proof of (b), we let ¢ > 0 be such that e < D. We find 6 > 0 with 
W2(5) < Wi (e). Let t] > to and ¢;, € C(t) with ||¢;, || < 6. Then 


Wilx(t, 1, On ))) SVG, x11, bn) S Vs On) 
< W2(6) < Wile), 


from which it follows that 


x(t, t1, $1 < Wy '(Wile)) =e. 


This concludes the proof of (b). 

To prove (c), let tf) > fo, and let 0 < e < D. Find 6 as in part (b) and take n = 6. 
Let $;, € C(t) with ||¢;,|| < 6. For simplicity, we write x(t) = x(t, t1, b;,). We will 
establish the proof by contradiction. Assume that x(t) + 0 as t — oo. Then there are 
€, > 0 and a sequence {t,} — oo with |x(f,)| > €1. Since |F(t, W)| < M forto <t < 
oo and ||y¥;|| < D, there are T > 0 and €2 < €, with |x(t,)| > €2 fort, <t<t,+T. 
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From this and condition (8.4.7) it follows that 


t 
0<V(t,x) < Viti dn) -{ Wo (lx(s)1) 
ty 
n 14 
<Vi 6n)-> | 
ina vi 
LT 


n t4 
= V6.8) of Waten) 
ioe 


= V(t, b,) — (n — IT W2(e2) > —co as n> OW, 


T 
W2(Ix(s)|) 


a contradiction. This concludes the proof of (c). 


Theorem 8.4.2. Let D > 0. Suppose V(t, W;) is a scalar functional continuous in w 
and locally Lipschitz in w, when t = to and W; € C(t) with ||W|| < D. In addition, we 
assume that if x : [to — a, 00) > R” is bounded, then F (t, x;) is bounded on [to, 00). 
Suppose V satisfies V(t, 0) = 0, 


WiI¥ OD SVG, We) < Wella), (8.4.8) 


and 


V(t, Wr) < —W3(lW(0))). (8.4.9) 


Then the zero solution of (8.4.1) is uniformly asymptotically stable. 
Proof. We refer to [15]. 


In the next theorem, we use a Lyapunov function and obtain boundedness results 
concerning non-homogeneous delay differential equations. 


Theorem 8.4.3. Let h > 0 and consider the finite delay differential equation 
x(t) =a(t)x(t) +b(x(t —h) + g(t), t= 0, (8.4.10) 


with x(to) = (to), —h < to < 0. Suppose a(t), b(t), and g(t) are continuous for all 
t>0. 
Assume that 


2a(t) +3 + |b@)| <0, (8.4.11) 
|b(t)| —e" <0, (8.4.12) 
and there exists a positive constant L such that 
IS@|<L, t20. 


Then all solutions of (8.4.10) are uniformly bounded. Moreover, if g(t) = 0 for all 
t > 0, then the zero solution is exponentially stable. 
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Proof. For t > 0, let 


t 
V(t, x7) =x? (+ / ex? (5) ds. 
t—h 
Then along solutions of (8.4.10) we have 


V'(t, x) = 2a(t)x?(t) + W(x (x(t — h) + 2x(Hg( +.x7° (0) 
a6" eo hy= [ e "9 x2(5) ds 
th 
< Qa(t) + 2+ |b@)|)x7(0) + (| — ext — h) 
= / © e926) ds + 20. 
t—h 
Using conditions (8.4.11) and (8.4.12), we have 
V(t, x1) + V(t, x7) < Qa(t) +3 + |b)))x27() + (b@)| — e7")x2(t — hb) 
= [ e €—-)x2(9) ds + [ e "—5) x? (9) ds + 97(t) 
t—h t—h 
<9°(t) <L’. 
So we have 
VG VE, 
It follows from the variation of parameters formula that 


|x| < [V (to, pye "—0) ue Seale 


OY oie ii 2 ti) 5-721" 
s[a+f eds) lig |P? e+ 7] 


o—h 


1/2 
<[2-e"lelP en +12]. 


This gives boundedness. Now if g(t) = 0 for all t > 0, then L = 0, and hence the 
above inequality gives the exponential stability. 


We end this section by noting that despite the results of Exercises 8.8 and 8.9, 
researchers are still trying to substitute delay terms with terms that are independent 
of delays and arrive at ordinary differential equations that can be explicitly solved. 
This could be a good prospect for research using numerical analysis. 
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8.5 Stability using fixed point theory 


Lyapunov functions and functionals have been successfully used to obtain bound- 
edness, stability, and the existence of periodic solutions of differential equations, 
differential equations with functional delays, and functional differential equations. 
In the study of differential equations with functional delays by using Lyapunov func- 
tionals, many difficulties arise if the delay is unbounded or if the differential equation 
in question has unbounded terms. This section is mainly concerned with the asymp- 
totic stability of the zero solution of the scalar neutral differential equation 


x'(t) = —a(t)x(t) + c(t)x'(t — g(t) + g(t, x), x(t — g(t), (8.5.1) 


where a(t), c(t), g(t), and q are continuous in their respective arguments. What 
makes Eq. (8.5.1) interesting to study is the fact that it cannot be put in the form 
of 


d 
qi eae = BG) = aye) r q(t, x(t), x — g(t))), 


and hence a direct integration cannot be performed to arrive at the desired mapping. 
We could not construct a suitable Lyapunov functional that yielded any meaningful 
results about the asymptotic stability of the zero solution. Hence the construction of 
such a Lyapunov functional for Eq. (8.5.1) remains open. Moreover, in this study, 
we concentrate on the stability of the zero solution of nonlinear neutral differential 
equations with bounded and unbounded delays. To achieve our goal, we make use 
of the contraction mapping principle. To justify the need of using fixed point theory 
when studying stability, we consider the time-varying delay differential equation 


x'(t) = —a(t)x(t) + b()x(t — g(t)), (8.5.2) 


where a and b are bounded continuous functions, and g is continuously differentiable 
and nonnegative. 


Theorem 8.5.1. Suppose 


g(t) is bounded, 1 — g'(t) > 0, (8.5.3) 
—2a(t)+1<—-U—-g’(t)), (8.5.4) 

and 
|b(t)| <a — g'(t)) for some a € (0, 1). (8.5.5) 


Then the zero solution of (8.5.2) is uniformly asymptotically stable. 


Proof. Define the Lyapunov functional 


t 
vo=eot f x°(s) ds. 
t—g(t) 
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Then along solutions of (8.5.2) we have 


V'() = 2x()(—ax() + Ox — gO) +P — A—')0- gO) 
< —2a(t)x*(t) + [b() [x7 (0) + [BO lx? (t— 8) 
+x°@) — (l= g'(O)x°(¢— 8) 
= (-2a(f) + bOI + 1)°O) + (bOI= A= 8’) = 8) 
< (@— N= 8')(P7 +27 = g)) 
<(@— 1) —g'())x"@). 


The result follows from Theorem 8.4.2. 


We remark that (8.5.4) and (8.5.5) imply that |b(t)| < a(2a(t) — 1). Thus we see 
that |b(t)| must be bounded by a(t). In addition, a(t) must satisfy a(t) > 1/2. 


8.5.1 Neutral differential equations 


Conditions (8.5.3) and (8.5.4) are severe since a and b must be bounded and both a 
and b must satisfy an upper bound in terms of | — g’. To relax the restrictions, we 
resort to the use of fixed point theory, namely, the contraction mapping principle. To 
better illustrate our procedure, we first consider the scalar linear neutral differential 
equation (neutral since there is a delay in the derivative) with unbounded delay 


x'(t) = —a(t)x(t) + b@)x(t — g(t) + e(t)x"(t — g()), (8.5.6) 


where a(t) and b(t) are continuous, c(t) is continuously differentiable, and g(t) > 0 
for all ¢ € R and is twice continuously differentiable. We note that Eq. (8.5.6) is more 
complicated than that we considered in Theorem 8.5.1 since the derivative on the 
right side has a delay. Hence the Lyapunov functional that was used in the proof of 
Theorem 8.5.1 will not work, and we have to construct a suitable one. However, the 
author believes that conditions similar to (8.5.3)-(8.5.5) have to be imposed. Using 
fixed point theory, a suitable mapping has to be formulated. To obtain the desired 
map, we invert Eq. (8.5.6). During the process of inverting (8.5.6), we have to inte- 
grate by parts the term involving x’(t — g(t)). We begin by requiring that 


giAl, VteR. (8.5.7) 
Definition 8.3.1 naturally extends to suit Eq. (8.5.6). 


Lemma 8.1. Suppose (8.5.7) holds. Then x(t) is a solution of Eq. (8.5.6) if and only 
if 
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x)= (x) — SO cg )e Warm 4 Oe gta) 


L=2'(Q) 1 — g'(t) 
t 4 
2 / (r(u) — b(u))x(u — g(u)yew fu 94 dy, (8.5.8) 
0 
where 
(c'(u) + e)a(u)) (1 = @'w) + ¢"We(w) 
r(u) = —S : (8.5.9) 
Cd — g’(u)) 
Proof. Multiplying both sides of (8.5.6) by eo 84S and then integrating from 0 to f, 
we obtain 


t ! t : 
/ [xe a4 | du = / [owox(u = ga) + ex’ w= gw) fel4au, 
0 0 


As a consequence, we atrive at 


hi t u 
x (tel aeras — x(0) = [ [owox(u = gu) + ex’ w= gw) fel du. 


a(s)ds we obtain 


Dividing both sides of the above equation by ely 
x(t) =x()e~ fo ads 
t t 
+f [owpx(u — g(u)) +c(u)x'(u — g(u)) feed, (8.5.10) 
0 


Rewrite 


‘ t 
I clu)x!(u = gue fd 
0 


_ [ c(u)x/(u = gw) = 8'W) ft aisyas gy, 
0 (1 — g/w)) 


Integrating by parts the above integral with 


U(u) = OO _¢- fraisus 


1— g/(u) 
and 
dV =x'(u— g(u))(1— g'(u))du, 
we have 
t 4 
i c(u)x!(u — g(u)ye Lu 448 dy = ace g(t)) 
0 1— g’(t) 


c(O) 


t t t 
— ——_x(—g@))e7 0945 -f[ r(uye Ju @45x(y — g(u))du, (8.5.11) 
1 — g’(0) 0 
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where r(u) is given by (8.5.9). Finally, substituting (8.5.11) into (8.5.10) completes 
the proof. 


Next, let w(t) : (—oo, 0] — R be a continuous bounded initial function. We say 
that x(t) := x(t, 0, w) is a solution of (8.5.6) if x(t) = W(t) for t < 0 and satisfies 
(8.5.6) for t > 0. 

We say that the zero solution of (8.5.6) is stable at fo if for each ¢ > O, there 
is 6 = 8(e) > 0 such that [yr : [—00, to] > R with |y()| < 6 on (—00, fo], t= to] 
implies |x(t, to, W)| <eé. 


Let C be the space of all continuous functions from R — R and define the set 


S=|9:R>R| 9 =VO ifr <0, gf) >Oast>w, geEC, 


and ¢ is bounded}. 


Then {S, || - ||} is a complete metric space, where || - || is the supremum norm. 


For the next theorem, we impose the following conditions: 


e ads _. 9 ast oO, (8.5.12) 
there is a > O such that 
t t t 
Je | +f Ir(u) — b(u)lew Ju "45 du <a@ <1,t>0, (8.5.13) 
1— g’(t) 0 
and 
t—g(t) > wa tow. (8.5.14) 


Theorem 8.5.2. If (8.5.7) and (8.5.12)-(8.5.14) hold, then every solution x(t, 0, w) 
of (8.5.6) with small continuous initial function w(t) is bounded and goes to zero as 
t — oo. Moreover, the zero solution is stable at to = 0. 


Proof. Define the mapping P : S > S by 
(P9)(t)= wt) if r<0 


and 


_ _ c(0) = — fj a(s)ds c(t) 
(Pe) = (¥O — Vs )e hae + 


t t 
= f [ren = pan }otu = genre atau, += 0 
0 


p(t — g(t) 


It is clear that for g € S, Pg is continuous. Let g € S with ||g|| < K for some positive 
constant K. Let w(t) be a small continuous initial function with |y| < 6,6 > 0. Then 
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using (8.5.13) in the definition of (P@)(t), we have 


c(0) c(t) 
Op OO” 
T=" @)* + =e@ 

‘ t 
+f Ir(u) — buen 4945 dy K 

0 
ey 
1—g'0) 


(Pe) Il <a — |K 


<|(1- JS +aK, (8.5.15) 


which implies that II(P¢) (t)|| < K for the right 5. Thus (8.5.15) implies that (Pg) (t) 
is bounded. Next, we show that (P¢) (t) > 0. as t > ow. The first term on the right 
side of (P¢) (t) tends to zero by condition (8.5.12). Also, the second term on the right 
side tends to zero because of (8.5.14) and the fact that g € S. It remains to show that 
the integral term goes to zero as t > oo. 

Let ¢ > 0, and let g € S with ||g|| < K, K > 0. Then there exists t; > 0 such that 
|p(t — g(t))| < ¢ for t > tj. Due to condition (8.5.12), there exists t2 > t; such that 


, 
= d 
e fi, a(s)ds < _ for t > fo. Thus for t > to, we have 


‘ ; 
| i (r(u) — b(u)) ou — g(u)yew Ju 4S dy 
0 


ty t t t 
<x | Ina) — beanie du +e f Ir(u) — b(u)jew fu 445 ry 
0 


t 
t t 
<Ke In sal Ir(w) — b(u)lew Le 45 dy + re 
0 

Soke te a(s)ds sheiphd 

<e+ae. 
Hence (P¢) (t) > 0 as t > oo. It remains to show that (P¢) (t) is a contraction 
under the supremum norm. Let ¢, 7 € S. Then 


t t 
(Pn - (PMO) s (1 + fire —bante edu} — nl 
<allf — all 


Thus by the contraction mapping principle, P has a unique fixed point in S, which 
solves (8.5.6), is bounded, and tends to zero as ¢ tends to infinity. The stability of the 
zero solution at f9 = 0 follows from the above work by simply replacing K by e. This 
completes the proof. 


Example 8.4. Consider the linear neutral differential equation 


x'(t) = —2x(t) +9 x(t — (5). (8.5.16) 
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where cg is a constant. Then r(w) = —4co, and condition (8.5.13) is satisfied for 
Ico] < 7 a € (0, 1). Let y(t) be a given continuous initial function with |y(t)| < 6. 
Let 


S={o:R>R| eQ=VO ifr <0, g(t) > Oast > c=, GEC, 
and ¢ is bounded}. 


Define 
(Pe)(t) =v) if t<0 
and 
(Pg)(t) = (a aa 2co) WO) )e™ + 2cvp(5) 


t 
+f deop(5 Je du, t>0. 
0 


Then, for y € S with ||g|| < K, where K > Sate we have ||(Pg)(s)|| < K. It 


is obvious that conditions (8.5.12) and (8.5.14) are satisfied. To see that P defines 
a contraction mapping, let ¢,7 € S. Then 


(Pz)(t) — (Pn)(1)| < 2lcol If — all + 2leol( — e*)I1¢ = all 
S4leol NE — nil sa@llg — nll. 


Hence by Theorem 8.5.2 every solution x(t, 0, w) of (8.5.16) with small continuous 
initial function w(t) : (—oo, 0] > Ris in S, is bounded, and goes to zero as t > oo. 


Next, we turn our attention to the nonlinear neutral differential equation with 
unbounded delay 


x'(0) = —a(x(0) + Ox" = 8) + g(x. 20 = 8), (8.5.17) 


where a(t), c(t), and g(t) are defined as before. Here we assume that g (0, 0) = 0 and 
q is locally Lipschitz continuous in x and y in the sense that there is K > 0 such that 
if |x|, |yl, lz], |w| < K, then 


lg(x, y)-—q(z, w)| < L|x —z|+ Ely —w| (8.5.18) 


for some positive constants L and E. 
Note that 


lg(x, yl =la@, y) — gO, 0) + ¢(0, 0)| 
< lq, y) — (0, 0)| + lq (0, 0)| 
< L|x|+ Ely. 
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Let 


S={o:R>R| IV|| < K, g(t) = W() ift <0, g(t) > Oast > 00, pe CI. 
Define the map P: S > S by 


(Py) =wit) if r<0 
and 


c(0) — fh a(s)ds c(t) = 
Tag VR) Je HOO + ott — 90) 


; t 
+f [-rwow — g(u)) + qe), gu — gu))) Jen a(sdsay ¢>0, 


(Pe) =(VO-s 


It is clear that Pg is continuous for g € S. If P has a fixed point, say , then ¢ is 
a solution of (8.5.17). For P to be a contraction, we assume that there is ~@ > 0 such 
that 


| c(t) 


! t 
1 Z|+ (r(u)| +L + Eye Sut dy <a <1,t>0. (8.5.19) 
—8§ 0 


Theorem 8.5.3. Jf (8.5.7), (8.5.12), (8.5.14), and (8.5.19) hold, then every solution 
x(t,0, %) of (8.5.17) with small continuous initial function w(t) : (—oo,0] > R 
goes to zero as t > ©. Moreover, the zero solution is stable at to = 0. 


Proof. Let g € S, and let t; and f be as in the proof of Theorem 8.5.2. Then for 
t> ft, 


‘ t 
f q(gu), pu — gu)))e~ v4 du 


<kie+8) |e Ue dat o(L +B) fe Las)ds ay 


<K(L+ Ee 12" [ en Iw 94S dy 4 e(L + Ea 
0 

_f" a(s)ds 

<aKe “1 +e(L+E)a 

<e+te(L+E)a. 


This, along with the proof of Theorem 8.5.2, shows that (P¢) (t) > Oast> ow. 
Let w(t) be a small continuous initial function with |y| < 6, 6 > 0. Then by using 
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(8.5.19) we arrive at 


c(0) c(t) 
(Pe) @Il< ld T- gO)? tiem * 
# t 
+ / (Ir(u)| +L + E)em fu 948 du 
0 
c(O) 
S10 ~ TT @ etek: (8.5.20) 


which implies that II(P¢) (t)|| < K with the right choice of 6 and qa. It remains to 
show that (Pg) (t) is a contraction. Let ¢,7 € S. Then 


(Penn — (Pm 


: i 
= (a! IIs = nll +f (In@plle@ = guy) — n= gue Le du 


1 — g’(t) 
‘ t 
+f lg(é(u), ¢(u — g(u))) = gin(u), n(u = gu) je #4 dul 
et) — fl a(s)ds 
s (Sait f (Ir@)|+L4+ Eje7 su du} IIe = nll 
= allo =I. 


Thus by the contraction mapping principle, P has a unique fixed point in S, which 
solves (8.5.17) and tends to zero as ¢ tends to infinity. This completes the proof. 


8.5.2 Neutral Volterra integro-differential equations 


Now we turn our attention to the scalar neutral Volterra integro-differential equation 
t 
x(t) = —a(t)x(t) + c(t)x’(t — g(t)) +f k(t, s)h(x(s))ds, (8.5.21) 
t—g(t) 


where 0 < g(t) < go for some constant go. Here we assume that g,a,c,h:R—-R 
and k: R x R= R are continuous. For the next theorem, we make the following 
assumptions: 


t t Ss t 
[Salt f [rot fi ts nidule hetuas ca < 1,020: 
1— &§ (t) 0 s—g(s) 


(8.5.22) 
for each € > O, there exist t; > 0 and T > O such that for m > t; andt > t2+T, we 
have 


t 
etn tds — 5 and e foasids _, 9 as t—> 00; (8.5.23) 
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and there is L > 0 such that |x|, |y| < Z imply that 
|h(x) —h(Qy)| < |x — y| and hA(O) =0. (8.5.24) 


Theorem 8.5.4. /f (8.5.22)—(8.5.24) hold, then the zero solution of (8.5.21) is asymp- 
totically stable at to = 0. 


Proof. Let w : [—go, 0] — R be a bounded initial function with |y| < 6 for some 
positive constant 6. Define 


S= {9 :[-g0,00) > R | 9) = VO if —go <1 <0, Ill SL, 


geEeCc, g(t) > ast —> ool, 


where || - || is the supremum norm. 
Define the mapping P: S > S by 


(Pe)t)=W(t) if —go<t<0 


and 


- Oe — fi a(s)ds c(t) _ 
(Pe) = (vo Te 8(0)))e 0 Tet e(t)) 


f t 
t / [=r(syots = g(s)) + / K(s, wh(xu))du Je“ “ds, 1 > 0, 
0 s 


—g(s) 


where r(u) is defined by (8.5.9). For g € S with ||g|| < LZ, we have that for any e > 0, 
there exists ¢; > 0 such that ¢t > t; — go implies that |g(t)| < e. Similarly, t2 > ft; and 


t >t) +T imply that e 422” <6. Thust>m+T andh large enough give 
c(O) c(t) 
P)(t)|| < | — —————)|ée + |———_ e 
MPa) @ll <1 - ~— Tbe + |G! 


ft Ss t 
+ i [Irv + i K(s, w)Ldu]e~ Ir aeang Ingen gs 
0 s—g(s) 


t Ss t 
+/ [rooe+ f Ik(s, wledu Jen «tas 
to s—g(s) 


oO) 5 a i 8.5.25 
T-7©” et+ls— ale tee + ea. ( ee. ) 


—_ 
= g'(t) 


Thus (P¢) (t) > 0 as t > oo. Also, as in the proof of (8.5.15), with the right 
choice of 5, we have that ||P(g)|| < L for ||g|| < L. It remains to show that P is 
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a contraction. For ¢, 7 € S, we have 


(PEy(t) — (Pn@)| = | lg — all 
t S z 
+ i [Irosy1 + / Ik(s, w)ldu Je“ Fs #4asi1¢ — nl 
0 s—g(s) 
<allg — all. 


Hence P has a unique fixed point in S. This completes the proof. 


We conclude this section by considering Eq. (8.5.21) when there is no delay in the 
derivative, that is, c(t) is identically zero. We use the Lyapunov functional method 
to show that the zero solution is asymptotically stable. As we try to show that the 
derivative term of the Lyapunov functional is less than zero along the solutions of 
the desired equation, an unpleasant condition relating the size of a(t) to the size of 
g(t) arises, which limits the types of equations that can be discussed. In particular, 
we consider the scalar Volterra integro-differential delay equation 


t 
x’ (t) = —a(t)x(t) + / k(t, s)h(x(s))ds, (8.5.26) 
t—g(t) 


where 0 < g(t) < go for some constant go. 
Suppose there exists a positive constant 6 such that 


|k(t, s)| < B for all t > 0, (8.5.27) 
g(t) <1-£, (8.5.28) 

and 
a(t) > 6 : Da) for all t > 0. (8.5.29) 


Theorem 8.5.5. Jf (8.5.24) and (8.5.27)-(8.5.29) hold, then the zero solution of 
(8.5.26) is asymptotically stable. 


Proof. Define 


t in 
V(th=x°(t)+ / h?(x(v))dvds. 
t—g(t) ds 


It follows from (8.5.24) and (8.5.27) that along the solutions of (8.5.26) 
t 
Vij= 2x()[-ax(0) +f k(t, s)h(x(s))ds 
t—g(t) 


t 
—(1-g'(t)) / h?(x(v))dv + g(t)h?(x(t)) 
t—g(t) 
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t 
< —2a(t)x?(t) + 2B|x(0)| / |h(x(s))|ds 
t—g(t) 
t 
—(1—'(t)) i: h?(x(s))ds + g(t)h?(x(t)) 
t—g(t) 
t 
< —2a(t)x?(t) + B [27 + oG))ds| 
(t) 


t—g(t 


t 
—(1—g'(t)) h?(x(v))dv + g(t)h?(x(t)) 
t—g(t) 


t 
<x°()|-2a(t) + Ba) + 8] + 0-8’ +B) 


t—g(t 


h?(x(s))ds 
) 


< —yx7(t) for some positive constant y. 


Then by (c) of Theorem 8.4.1, the zero solution is asymptotically stable. 


8.6 Exponential stability 


In this section we consider the scalar and totally nonlinear Volterra integro- 
differential equation with finite delay 


t 
x(t)= -| a(t, s)g(x(s))ds, (8.6.1) 
t—r 


where r > 0 is a constant, and a: [0, 00) x [0, 00] > (—0o, oo). The function g(x) 
is continuous in x. 

The Lyapunov method allowed us to deduce inequalities that all solutions must 
satisfy and from which we deduce the exponential stability and instability. 


Let w : [—r, 0] ~ (—co, cv) be a continuous initial function with 
Ily|]= max |y(s)|. 
—r<s<0 


It should cause no confusion to denote the norm of a continuous function 9g : 
[—r, oo) > (—o0, oo) by 


llgll= sup |g(s)|. 
—r<s<oo 


The notation x, means that x,;(t) = x(¢ + T), t € [—r, 0], as long as x(t + T) is 
defined. Thus x; is a function mapping an interval [—/, 0] into R. We say that x(t) = 
X(t, fo, W) is a solution of (8.6.1) if x(t) satisfies (8.6.1) for t > fo and x4) = x(to + 
5) = w(s), s €[—r, OJ. 

Now we turn our attention to the totally nonlinear equation (8.6.1). We will con- 
struct a Lyapunov functional V(t,x) := V(t) and show that for some positive a, 


Copyright Elsevier 2022 


a 


310 CHAPTER 8 Delay differential equations 


under suitable conditions, V’(t) < —aV(t) along the solutions of (8.6.1). To rewrite 
(8.6.1) so that a suitable Lyapunov functional can be displayed, we let 


* 
A(t, S) =) a(u+s,s)du, t,s>0, 
t—s 


and assume that 
Ag.n= [aut rndu>o. (8.6.2) 
In preparation of the main results, we assume that 
xg(x) > x? if x £0 (8.6.3) 
and there exists a positive constant 4 such that 
|g(x)| SAlx]. (8.6.4) 


It is clear that conditions (8.6.3) and (8.6.4) imply that g(0) = 0. In addition to the 
above assumptions, we require that 


A(t, S) 


dA(t, s) 
a <0 forall (¢,5) €[0, 00) x [t —r, ft]. (8.6.5) 


Finally, we assume that for 1 <a < 2, 


A? (t — (a — 1)r/a, z) > A(t, z) (8.6.6) 


for all t € [0, co) and z € [t —r/a,t — (a — 1)r/a]. As a consequence of (8.6.5), we 


have 
0 pt 
Ll ey ee 
—rdt+s 


=f i A(t, z C2 2 xte)yds dz 
t—r =f 


=| A(t, F eeoal seit 2, g*(x(z))\(z—t+r)dz 
t—r 
<0, (8.6.7) 


which plays an essential role in the proof of the next lemma. We note that g(x) = 
x (sin? (x) + 1) satisfies (8.6.3) and (8.6.4). To construct a suitable Lyapunov func- 
tional, we put (8.6.1) in the form 


d t 
x'(t)=—A(t, g(t) + | A(t, s)g(x(s))ds. (8.6.8) 
t—r 
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Lemma 8.2. Let (8.6.2)-(8.6.5) hold, and suppose that 0 <r < 1/2 with 


[rts Pawtrndu)?s faw+tndus oma (8.6.9) 
If 
t 2 
vn=(x@- f A(t, s)g(x(s))ds) 
t—r 
0 t 
+ / , A(t, z)g7(x(z))dz ds, (8.6.10) 
—rdt-+s 


then along the solutions of (5.6.1) we have 
VQ) SANDY). 


Proof. Let x(t) = x(t, to, %) be a solution of (8.6.1) and define V(t) by (8.6.10). 
Then along solutions of (8.6.1) we have 


t 
V'() =2(x() - if A(t, s)a(x(s))ds )[-AG, Nga] 
t—r 
+rA*(t, Dg cn f Ar(t,t +s)g7(x(t +5))ds 


+f f 2A(t, je oem 
—rJdt+s 


<—A(t,1)[x? (1) — 2x(t) " AG,s)e((s))ds] + r22A2C, D220) 


t—r 


-f A’ (t,t + s)g7(x(t +5))ds — A(t, t)x?(t) by (8.5.6) 


t t 


— 2A) [ AG.seCe(ds+2AG, eG) [ AG.seCe(sds 
=-ae.nven+ ant f . A(t, s)g(x(s))ds)" 

~2A(t,t)x(t) [ A(t, s)g(x(s))ds + A(t, 1) / : [ AX(t, e2(x(e))dz ds 
+2A0,Dex(0) f AC, s)g(x(s))ds 

+ (ri7A7(t, SP A(t, t)x?(t)) 


0) 
-{ A7r(t,t+s)g7(x(t +5))ds. (8.6.11) 
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In what follows, we perform some calculations to simplify (8.6.11). First, if we let 
u=t-+s, then 


0 t 
-f[ Mt eset +s)ds=— f A(t, s)g7(x(s))ds. (8.6.12) 
=F t—-r 


Also, by Holder’s inequality we have that 


t t 
A(t, n( [ A(t, s)g(x(s))ds)° < A(t, pr | ren s)g7(x(s))ds. (8.6.13) 
t-r 


t—r 
Finally, we easily observe that 


t 


0 t 
Aca f i A(t, z)g?(x(z))dz dss acne | A(t, s)g7(x(s))ds (8.6.14) 
—rdtt+s t 


=F 
and 


t 
—2A(t, t)x(t) A(t, s)g(x(s))ds < A7(t, t)x7(t) 


t—r 


t 
+rf A7(t, s)g7(x(s))ds. (8.6.15) 
t—r 


Similarly, 


t 
2A(t, t)g(x(t)) A(t, s)g(x(s))ds < 27 A7(t, t)x7(t) 


t—r 


E 
+rf A*(t,s)g*(x(s))ds. (8.6.16) 
t—r 


Invoking (8.6.12) and substituting expressions (8.6.12)-(8.6.16) into (8.6.11) 
yield 


V(t) <-AQ OVO + [+ DVA70,0) + A720, — ACD ]x°O 
t 


+(2rAG H4+2r = uf A(t, s)g7(x(s))ds 


t—-r 


<—A(t,t)V(t) by (8.6.9). (8.6.17) 


Theorem 8.6.1. Assume that the hypotheses of Lemma 8.2 and (8.6.6) hold, and let 
1 <a <2. Then any solution x(t) = x(t, to, W) of (8.6.1) satisfies the exponential 
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inequality 


ee. eis. 
— 1 pt“ 
In@I< |2——ZVpye2 40“ AG as (8.6.18) 


a 


a-—1l 


fort >to + ( yr. 


Proof. By changing the order of integrations we have 
0 ft t zt 
i / A(t, z)g°(x(z))dz ds = / / A*(t, z)g7(x(z))ds dz 
—rdt+s t—rJ—-r 
t 
= / AP, z)g*(x@))(Z—t + r)dz. (8.6.19) 
t—r 


a—l 


For 1 <a <2,ift— 7 <z<t, then ( yr <z—t+r <r. Expression (8.6.19) 
a 


a 
yields 


0 t t 
/ / A2(t, 2)9?(x(z))dz ds = / PG nore 
—r Jtt+s t—r 


‘5 t 
= i A2(t, 2)e2(x(2) le —t + r)dz + i} Mt, dgta@e—t+ dz 
t t— 


r 
: a 


t 
> / A2(t, 2)e2(x(2))(z —t + dz 
. 


oe 
a 


a—1 . 4 2 
= ( 7 )r A*(t, z)g° (x(z))dz. (8.6.20) 
a: 
Let V(t) be given by (8.6.10). Then 


0 t 
Vi= ‘ / A2(t, 2)9?(x(z))dz ds 
—rdtt+s 


a-—1 ar) 5 
at 5 wf A*(t, z)g° (x(z))dz. (8.6.21) 
f=2 


Using (8.6.6), this implies that, for 1 <a <2, 


t—r-+r/a 
V(t—(a—lr/a) > (a— iyr/e [ A*(t, z)g?(x(z))dz 
t—r 
t—r/a 
> (a — 1r/a / A’ (t, z)g?(x(z))dz. (8.6.22) 
t—r 
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Note that since V’(t) < 0, for t > to + es 


s we have that 


0< VO+V(-(— —*yr) s2v(1-C =), 


In summary, (8.6.11), (8.6.21), and (8.6.22) imply that 


t 3 
V+ V(t—(— =n (xo - | A(t, 8)g(x(s))ds) 
t—r 


f= 4 


" A(t, z)g2(x(z))dz 


t—r 


t 
ny if A2(t, 2)92(x(z))dz 
it 


+f [ A? (t, z)g2(x(g))dz ds + (— 
—rdt+s 


t =< 
=(x- fo Ac seconds) +E 
t—r 


a—1l t-5 y > 
+» 1 AX(t, 2)92(x(z))dz 
t—r 


: 2 a-l Pd 9 
= (x= f) At.seeeoyas) +r faa. aeoenaz 
t—r t-r 
t 2 
> (xw-f A(t,s)8(x(s))ds) 
t—r 


a—1 f 2 7 . . 
+ cf A(t, S)g(x (s))ds) (by Hélder’s inequality) 
a t—-r 


ars r(y+[ + —¥(4) jeff A(t, s)g(x(s))ds]” 
“Te jet ah 


a 


So 2 =a, (8.6.23) 


Thus (8.6.23) shows that 


a-—l 


a (0) SV) +V(C— 
141 


yr) 
a- 
< 2V(t — (——)r). 
<2V(1-(— ‘r) 
An integration of (8.6.17) from fg to t yields the inequality 
Vit) < Vite fo AG, 


Asa consequence, 


V(t = @ yr) < < Vi(to)e— i. (Gm) "A(s, nae 
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and 
a—l ; 1-21), 
Ix@|< |2——*-Vioe? Sig A(s,s)ds 
“a 
a-—1l ; 
for t > to + ( )r. This completes the proof. 


Remark 8.2. Itis clear that inequality (8.6.18) implies that the zero solution of (8.6.1) 
is asymptotically stable, provided that 


Cc 
; A(t, t)dt > w, 


and exponentially stable if 


t-(=S)r 
/ A(s,5)ds > B(t — to) 
t 


a-—1l 


for all t > to + ( )r and a constant 6 > 0. 


a 


sin? (x) 


As an example, we take g(x) = x( +1). Then g(0) = 0, xg(x) > x’, and 


5 1 1 
lg(x)| < qi: Choose a(t, 5s) = 5 and r = 3" Next, we make sure that (8.6.7) is 
satisfied: 


0 t t 
/ i; AG, 2) z) g?(x(z))dz ds = —a” i, (z—t+r)?97(x(z))dz <0. 
—rJdt+s t—r 


Thus we have shown that the zero solution of the nonlinear Volterra integro- 
differential equation 


t 2D 
rio=-; f CLE) 4 yas 
t=4 


3 


is exponentially stable. 


8.6.1 Instability 


We turn our attention to the instability of the zero solution of (8.6.1). We start with 
the following lemma. 


Lemma 8.3. Suppose (8.6.3), (8.6.4), and (8.6.5) hold and there is a positive constant 
D>r such that 


_ ne A(t,t) < —A7(t, )[(1 +)? + Da’). (8.6.24) 
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If 
t 2 
Vi) = (x@ - i; A(t, s)g(x(s))ds) 
t—r 
t 
=D) / A*(t, 287 (x(z))dz, (8.6.25) 
t-r 
then along the solutions of (8.6.1) we have 
V(t) > —A(t, V(t). 


Proof. Let x(t) = x(t, to, Y) be a solution of (8.6.1) and define V(t) by (8.6.25). 
Then along solutions of (8.6.1) we have 


t 
V'() = 2x - i A(t, ae Nga()] 
t—-r 
t 
— Dar, g(x) — Df 2A(t, ed) = 2) g°(x(z))dz 
t—r 


iE 
> 2(x(t) - / ee nn ee 
t—r 
= —A(t,t)V(t) 
t t 
-a.o[-Cf A(.s)gta(s)as)’ + f A(t, 2)87(x@))dz| 
t—r t-r 
t 
— 2A(t, t)[x(t) — econ) f A(t, s)g(x(s))ds 
t—r 
+ (-A(, 1) — A?DA?(t, 1) x70). (8.6.26) 


First, we remark that, as a consequence of (8.6.5), we have 


t 
-p | A(t, 2) a 1D) (x (2))dz > 0. 
t—r 


We note that 


t 
2A(t, tg (x (4) = x1 f A(t, s)g(x(s))ds 
t—r 
t 
SAAC OMS! +lADif AC, s)g(x(s))ds| 
t—r 
t 
SAG Ile +A) fo AG, sgx(s))ds| 


t—r 
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t 
2A OC Uae + (f A(t, s)g(x(s))ds)? 
t—r 


t 
M00 +20) +6 f A’ (t, s)g7(x(s))ds. 


t—r 


Similarly, 
t t 
ac.n( f A(a,s)g(a(s))ds)" = rac. | A’ (t, s)g?(x(s))ds. 
t—r t-r 


Hence (8.6.26) reduces to 
V(t) > -ACt, NV(t) — {A(t +1 +a)7 A720, 0) + DIZAZ(t, D} X27) 


t 
+ [Agno = D)=r] f A’ (t, s)g?(x(s))ds 
= 


—f 


= —A(t,t)V(t). (8.6.27) 


This completes the proof. 


Theorem 8.6.2. Suppose hypotheses of Lemma 8.3 hold. Then the zero solution of 
(8.6.1) is unstable, provided that 


foe) 
-| A(s,s)ds=oo. 
a) 


Proof. An integration of (8.6.27) from fo to ¢ yields 


A(s,s) ds 


V(t) = Vito)e Lr (8.6.28) 


Let V(t) be given by (8.6.25). Then 
t 


V(t) = x7(t) — 2x(t) 


t—r 


t 
= / A(t, z)@?(x(2))dz. 
t—r 


t 2 
A(t, s)g(x(s))ds + [| A(t, 8)g(x(s))ds 
t—r 
(8.6.29) 


Let 6 = D—r. Then from 


r VB 2 
—~a — —=b)° >0 
(754 7 y= 
we have 
2ab < ‘a + Pip 
B r 
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With this in mind, we arrive at 


t t 

—2x(t) A(t, s)g(x(s))ds < 2|x(0)|| A(t, s)g(x(s))ds| 
bak t-r 

ri5 B 

< ra (t) + 


[[ Aeseconas] 


t 
< gr + orf A(t,s)g(x(s))ds. 


t—r 
A substitution of the above inequality into (8.6.29) yields 


r t 
VQ <x*()+ go) +(B+r—D)] Ar(t,s)g?(x(s))ds 


t—r 


— aa 1 a 


D 
D-r 


x7(t). 


Using inequality (8.6.28), we get 


iol> (-—" vi2@ 


D-r 


—1f" A(s,s) ds 
=f VP eoye oO, 


This completes the proof. 


sin? (x) 
100 
101 1 1 1 
lg(x)| < Too !*!: Choose a(t, 5) = —> r=-,andD= z Then (8.6.24) is satisfied. 


8 
Also, it is clear that (8.6.7) holds. 
Thus we have shown that the nonlinear Volterra integro-differential equation 


ee ee sin? (x(s)) 
x(th= 5 i: x(8)(—F og + Ids 


As an example, we take g(x) = x( + 1). Then g(0) = 0, xg(x) > x’, and 


is unstable. 
We end this section with the following open problem. 


Open Problem. In light of this research, what can be said about the exponential sta- 
bility and instability of the zero solution of the nonlinear Volterra integro-differential 
equation with infinite delay 


t 
x (tH= -{ a(t, s)g(x(s))ds? 
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8.7 Existence of positive periodic solutions 


We consider the nonlinear neutral differential equation with functional delay 
x'(t) = —a(t)x(t) + e(t)x"(t — 9) + a, x(t — g(@))), (8.7.1) 


which arises in food-limited population models. For system (8.7.1), there may be a 
stable equilibrium point of the population. In the case the equilibrium point becomes 
unstable, there may exist a nontrivial periodic solution. Then the oscillation of solu- 
tions occurs. The existence of such a stable periodic solution is of quite fundamental 
importance biologically since it concerns the long-time survival of species. The study 
of such phenomena has become an essential part of the qualitative theory of differen- 
tial equations. One of the most used models, a prototype of (8.7.1), is the system of 
Volterra integro-differential equations 


N(t)=—y(@)N(t) + ait) [ B(s)e BONES) gs, 
0 


where N(t) is the number of red blood cell at time ft, a, 8, vy € C(R,R) are 
T-periodic, and B € L!(Rt) is piecewise continuous. This is a generalized model 
of the red cell system introduced by Wazewska-Czyzewska and Lasota 


a(t) =—yn(t)+ae Fe™, 
where a, 8, y, and r are constants with r > 0. The existence of positive periodic 
solutions was established for the neutral logistic equation with distributed delays 
n 0 m 0 
x(tHh= TOO) _ > a;(t) i x(t +6) dj; (0) — 2 bj(t) / _ x (t+6)dv; @)|, 
i=l —f = Tj 


(8.7.2) 
where the coefficients a, a;, and b; are continuous periodic functions with the same 


period. The values 7;, T; are positive, and the functions j1;, v; are nondecreasing with 
[oy, dui = 1 and c dv; = 1. Eq. (8.7.2) is of logistic form, and hence the method 
used to obtain the existence of positive periodic solutions will not work for our model 


(8.7.1). For example, in the above equation the transformation x(t) = eN® was used 
to put (8.7.2) in the form 


n 0 
N'(t) = a(t) — Dl ai(t) / eNO dui) 
i=1 Ti 


m 0 
— Saji / N+ ye dy; (6). (8.7.3) 
j=l “ty 


Eq. (8.7.1) represents a generalization of the hematopoiesis and blood cell production 
models. 
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The Krasnoselskii fixed point theorem has been extensively used in differential 
and functional differential equations by Burton [16] to prove the existence of periodic 
solutions. Also, Burton was the first to use the theorem to obtain stability results 
regarding solutions of integral equations and functional differential equations. For a 
collection of different type of results, we refer the reader to [16] and the references 
therein. The author is unaware of any results regarding the use of Krasnoselskii to 
prove the existence of a positive periodic solution. 


Theorem 8.7.1. (Krasnoselskii) Let M be a closed convex nonempty subset of a 
Banach space ( B, |l- ||). Suppose that A and B map M into B and satisfy the following 
conditions: 


(i) A is compact and continuous, 
(ii) B is a contraction mapping, 
(iii) Zfx, y € M, then Ax + By €M. 


Then there exists z € M such that z= Az+ Bz. 


For T > 0, define Pr = {@ € C(R, R), d6(t + T) = d(t)}, where C(R, R) is the 
space of all real-valued continuous functions. Then Pr is a Banach space when en- 
dowed with the supremum norm 


I|x || = max |x(¢)| = max |x(r)|. 
te[0,T] teR 


We assume that 
att+T)=a(t), ct+T)=c(t), gt+T)=e(), go>=g*>0 (8.7.4) 


with continuously differentiable c(t), twice continuously differentiable g(t), and con- 
stant g*. Usually, a(t) is assumed to be positive, but here we only require that 


T 
/ a(s)ds > 0. (8.7.5) 
0 


It is interesting to note that Eq. (8.7.1) becomes of advanced type when g(t) < 0. 
Since we are searching for periodic solutions, it is natural to require that q(t, x) 
is continuous in both arguments and periodic in t. Also, we assume that for all 
O<t<T, 


(HA. (8.7.6) 
Lemma 8.4. Suppose (8.7.4)-(8.7.6) hold. If x(t) € Pr, then x(t) is a solution of 
Eq. (8.7.1) if and only if 


_ c(t) 
x(t) = io" — g(t)) 


t+T 
+f [-renxte = 200) +40 x= 200] 
t 


Pi a(s)ds 


—————_ du, 8.7.7 
elo a(s)ds 1 ( ) 
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where 


(c'W) + eat) (1-8) +2"et) 
a= : 


Proof. Let x(t) € Pr be a solution of (8.7.1). Multiply both sides of (8.7.1) with 
el) 445 and then integrate from t to t + T to obtain 


t+T , j t+T 
/ [xael | du= / [ewu)x!(u — g(u)) 
t t 


+ qu, x(u), x(a ~ g(u))) fel du. 


r(t)= (8.7.8) 


As a consequence, we atrive at 
x(t + Tyelo | as)as _ x(thelo ads 


t+T ; 
= / [eu)x!(u — glu)) +qtu,x(u— gu))) Jel a(s)ds gy 
t 


By dividing both sides of the above equation by elo’ 448 and the fact that 
x(t + T) = x(t) we obtain 


t4T -1 ttt 
x(t)= (1 Sgr aide | [ewu)x'(u — g(u)) 
t 
+ q(u, xu), xu = guy) fer OM dy (8.7.9) 


Rewrite 


t+T i 
i c(u)x!(u = gue" 404 dy 
t 


_ c(u)x'(u — g(u)) 1 — g/(u)) onda as)ds ay 
' (1 — g/(u)) . 


Integrating by parts the above integral with 


= c(u) oo Sit atsyas 
1 — g’(u) 


and 


dV =x'(u— g(u))( — g’(u))du, 
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we obtain 


tT t+ t4+T 
} si = g(u)ewse a(s)ds gy — ot = g(1 ego ae) 


t+T ; 
-| r(uyen Si 48 xy — g(u))du, 
rf 


where r(x) is given by (8.7.8). Finally, due to the integration over one period and the 
periodicity of all functions, we have that 


t+T t+T 


en Su a(s)ds edu a(s)ds 
1— on e*! a(s)ds ~ on Set! a(s)ds (efi * a(sds Sih 
elt a(s)ds Abe a(s)ds 


~ oli’ a(s)ds —1 a elo a(s)ds _ 1 


This completes the proof. 


To simplify notation, we let 


Pg la(s)|ds 


~ oh asyds 1 (8.7.10) 
and 
en Jo” la(s)ids 
mn feds — (8.7.11) 
Let 
oly Usds 
a (8.7.12) 


elo a(s)ds = 1 


It is easy to see that for all (t, uw) € [0,27] x [0,27], 
m<G(t,u) <M, 
and for all t, wu € R, we have 
G(t+T,u+T)=G(t,u). 


We obtain the existence of a positive periodic solution by considering two cases: 


@0s7_7@ * > 

and 

oie 2 : 
1 — g’(t) 
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For some nonnegative constant L and positive constant K, we define the set 
M={¢e Pr: L<||¢|| < K}, 


which is a closed convex bounded subset of the Banach space Pr. In addition, we 
assume that there are constants 0 < 6 < a@ < 1 such that 


pepe 2g 2) (8.7.13) 
< = Ty 2*<h T. 
and for all uw € R and pe M, 
1—B)L l—a)K 
CAF <4(s,p) rs) s SOR (8.7.14) 


where M and m are defined by (8.7.10) and (8.7.11), respectively. To apply Theo- 
rem 8.7.1, we need to construct two mappings: one is a contraction, and the other is 
compact. Thus we define the map A: M —> Pr by 


t+T 
(Ag)(t) = i, Git, s)Ig(s, p(s — 8(s))) —r(s)g(s — g(s))] ds,t eR. (8.7.15) 
t 


In a similar way, we set the map B: M — Pr by 
c(t) 
Logit) 


It is clear from condition (8.7.13) that B defines a contraction mapping under the 
supremum norm. 


(Be) (t) = g(t — g(t)), ER. (8.7.16) 


Lemma 8.5. /f (8.7.4)-(8.7.6), (8.7.13), and (8.7.14) hold, then the operator A is 


completely continuous on M. 


Proof. For t € [0, T], which implies that uw € [t,t + 7] C [0,27], and for g € M, we 
have by (8.7.13) that 


t+T 
I(Ag)(t)| <I / G(t, s)[q(s, p(s — g(s))) —r(s)o(s — g(s))] ds|| 
t 


(l—a)K 
2. 
MT 


From the estimate of |Ag(t)| it follows that 


c(t) 
\|Ag(t)|| < d — i-=2@ <Q) 


for some positive constant Q;. This shows that A(M) is uniformly bounded. It re- 
mains to show that A(M) is equicontinuous. Let g € M. Then a differentiation of 
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(8.7.13) with respect to t yields 


(Ag) (t) = G(t,t + T)lg(@t, p@ — g(1)) — re — gO) + a(t) (Ag)(). 
Hence by taking the supremum norm in the above expression we have 


Agy'll s S + llamllar. 


Thus the estimation on |(Ag)’(t)| implies that A(M) is equicontinuous. Then by the 
Ascoli—Arzela theorem, we obtain that A is a compact map. Due to the continuity of 
all terms in (8.7.13) for t € [0, T], we have that A is continuous. This completes the 
proof. 


Theorem 8.7.2. If (8.7.4)-(8.7.6), (8.7.13), and (8.7.14) hold, then Eq. (8.7.1) has a 
positive periodic solution z satisfying L<z< K. 


Proof. Let g, w € M. Then by (8.7.13) and (8.7.16) we have that 


(Bg) (t) + (AY) (1) = mae — g(t)) 
bg7r) 
t+T 
+ G(t, s)[q(s, p(s — g(s))) —r(s)p(s — g(s))] ds 
t 
(l-a)K 
<ak + MT ——— = kK. 
MT 
On the other hand, 
(Bg)(t) + (AY) (1) = mu — g(t)) 
12’) 


t+T 
+f G(t, s)[q(s, p(s — g(s))) —r(s)pls — g(s))] ds 
t 


t+T 
> pL +m | [g(s, p(s — g(s))) —r(s)pls — g(s))] ds 
t 


(-A)L _ 


> BL+mT 
2 o mT 


L. 
This shows that Bg + Aw € M. All the hypotheses of Theorem 8.7.1 are satisfied, 
and therefore Eq. (8.7.1) has a periodic solution, say z, residing in M. This completes 
the proof. 


For the next theorem, we assume that there are constants —1 < 8 <a <0 such 
that 


-1<f<-— <a<0, (8.7.17) 
—¢ 
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and for all u € Rand p EM, 


L— BK K-aL 
ene <4q(s, p) —r(s)p < a (8.7.18) 


where M and m are defined by (8.7.10) and (8.7.11), respectively. 


Theorem 8.7.3. If (8.7.4)-(8.7.6), (8.7.17), and (8.7.18) hold, then Eq. (8.7.1) has a 
positive periodic solution z satisfying L<z< K. 


Proof. The proof follows along the lines of Theorem 8.7.2, and hence we omit it. 


Example 8.5. The neutral differential equation 


i= 2 Oe 0 b= =e: on _3.! (8.7.19) 
x =-—— sin Xx XxX wa Pa ie 
2 50 ~2¢—n)+100 25 


has a positive zr -periodic solution x satisfying 


heey, 
107° 


To see this, we let 


0 ee ee ee 
S, p) = ———- + =, r(s) = =sin“(s), an = =f, 
P8P)=" 24100 | 25 ge 8 
Then 
c(t) 1 

—— = — <]l, 

1-9) 50 
and 


1 15 
r(t)= Too i" (t). 


A simple calculation yields 
4.030 < M < 4.032 and 1.74 <m < 1.75. 


Let K =2 and L= and define the set M = {70 <vu <2}. Then for p € [ae 2], 


i 
10° 


10° 
we have 
heirs cost(s) 1 Gepes 
,p) —r(s)p = —=—— + — sin = 
dae p= 524100 100.” * 25 
(t) 
1 1 1 (= pas 
Fe eae ee (ye 
= 700 * 50° 25 ‘ MT 
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On the other hand, 
Bae) _ cost) 1 in?(u) 2 
SE eet ee ae 
(t) 
= 1 ™ d— gt 
25 mT , 


We see that all the conditions of Theorem 8.7.2 are satisfied, and hence (8.7.19) has 


a positive z-periodic solution x satisfying a <x <2. 


8.8 Exercises 


Exercise 8.1. Use the method of steps to find the solution of the delay differential 
equation with delay 1, 


x’ =-tx(t—1), t>0; x(s)=@(s) =12, —1<s <0, 
on the interval [0, 3] by considering the subintervals [0, 1], [1, 2], and [2, 3]. 
Exercise 8.2. Consider the delay differential equation with delay 1, 
x’ =ax(t)+bx(t—1), t>0, 
with initial function 
x(s)=g(s)=14+t, —l<s <0, 


where a and b ¥ 0 are constants. Use the method of steps to find the solution on 
the interval [0,2] by considering the subintervals [0, 1] and [1, 2]. Is the solution 
differentiable at the initial time to = 0? What about the differentiability at t = 1? 


Exercise 8.3. Consider the delay differential equation with delay 1, 
x’=x(th+x@¢—1), t>0, 
with initial function 
x(s)=g(s)=t, -l<s<0. 


Use the method of steps to find the solution on the interval [0,3]. Is the solution 
differentiable at the initial time to = 0? What about the differentiability at t = 1? 


Exercise 8.4. Solve the Bernoulli equation (8.2.5). 


Exercise 8.5. Repeat Example 8.3 for the delay second-order differential equation 
mu" (t) + bu' (t) + qu’ (t —r) + cu(t) =0, t > 0, 


where m, b,qg,c, and r are positive constants. 
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Exercise 8.6. Consider the delay second-order differential equation 
u(t) + au'(t) + bu'(t —r) =0, t > 0, 


where a, b, and r are positive constants. Write the delay equation into a system in x 
and y and use the Lyapunov-type functional 


0 ft 
Von may tory f / y?(u)du ds, y>0. 
—rdt+s 


(i) Show that if 
y =b and —a+br <0, 


then the zero solution is uniformly stable. 
(ii) Choose 


—2a 
y >b and —+y+b)<0 
r 


and show that the zero solution is asymptotically stable and uniformly asymptotically 
stable. 


Exercise 8.7. Give an example of application of Theorem 8.7.3. 
Exercise 8.8. Consider the delay differential equation 
x'(t) = —ax(t) + bx(t —r), >t) > 0, 
where a, b, and r are positive constants. Consider the Lyapunov-type functional 
t 
V(x) =x7(t) + bf x7(s)ds. 
t—r 


(i) Show that if a > b, then all solutions are bounded, and the zero solution is uni- 
formly stable. 

(ii) Show that if a > b, then the zero solution is uniformly asymptotically stable, and 
x?(t) € L![0, 00). 

(iii) Use part (i) to show that all solutions of 


x'(t)=—2x(t) +x(¢— 7), x0) = G(s), —T<5 <0, 20, 
are bounded. 
(iv) Replace the delay term x(t — T) in the delay differential equation given in (iii) 
with 
/ 1 2." 
x(t)— tx (t) + ae x 


and show that the solutions of the resulting equation are unbounded regardless of the 
size of the delay T. 
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Exercise 8.9. Consider the finite delay differential equation 
F 1 
x(t) =—3x(t) + -—x(t — 1), t= 0, (8.8.1) 
e 


with x(t) = y(s), -l<s <0. 

(a) Use Theorem 8.4.3 to show that all solutions of (8.8.1) are bounded and its zero 
solution is exponentially stable. 

(b) Replace the delay term x(t — 1) in (8.8.1) with x(t) — x’(t). Are the solutions of 
the resulting equation bounded? 

(c) Now replace the delay term x(t — 1) in (8.8.1) with x(t) — x/(t) + ae and show 
that the solutions of the resulting equation are unbounded. 


Exercise 8.10. Construct an example that satisfies the hypotheses of Theorem 8.5.5. 


Exercise 8.11. Let / > 0 and consider the finite delay differential equation 
x(t) =a(t)x(t) +b(@)x(t —h) + g(t), t= 0, (8.8.2) 


with x(to9) = g. Suppose a(t), b(t), and g(t) are continuous for all t > 0. For some 
t > 0, define the continuous function 


elo ols)ds 
E(t) = T+ 2h fi ek Os gy >0 (8.8.3) 
with 
|b@)| <hé(t), (8.8.4) 


where c(t) := 2a(t) + |g(t)|. Use the functional 
t 
V(t, x1) = x7(t) + ng | x°(s) ds 
t—h 
to show that every solution of (8.8.2) with x(¢o9) = @ satisfies the inequality 


t u 1/2 _1 ft 
Oil <[Vdo.9) + f [gal elo? au] e202", 
& 
to 


t 
where a(t) = c(t) + 2h&(t) and V(to, y) = v7 (0) + h&(to) / ; y*(s)ds. 
to—h 


Exercise 8.12. (Big project) Develop similar results as in Section 8.6 for the totally 
delayed differential equation 


x’ =ax(t—r), t>0, 


where a € R, and r is a positive constant. 
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New variation of 
parameters 


In this chapter we introduce new variation of parameters formula and apply the idea 
to ordinary and delay differential equations. The results of this chapter are totally new 
and should serve as foundations for future research. 


9.1 Applications to ordinary differential equations 


It is customary in a nonlinear differential equation to add and subtract a convenient 
term that allows us to invert the equation in question and obtain a variation of parame- 
ters formula, which can be used to obtain different results on the solutions. However, 
the added term will cause restrictions on the coefficients, and as a result, limit the 
class of equations that can be considered. In this section we adopt the terminologies 
of Chapter 2 with respect to definitions of solutions and other important matters. We 
just try to avoid redundancies and repetitions. Consider the simplest ordinary differ- 
ential equation 


x'(t) =ax(t), x(0)=xo, (9.1.1) 
which has the solution 
x(t) = xoe"’ > Oast > ov, 
provided that 
a<0. 


Suppose a : R — R is continuous and consider the ordinary differential equation with 
variable coefficient 


x(t) =a(t)x(t), x(0) = xo, (9.1.2) 
which has the solution 


a(s)ds 


t 
x(t) = xpelo —> Oast> oo, 


provided that 


t 
i a(s)ds > —0o. (9.1.3) 
0 


Advanced Differential Equations. https://doi.org/10.1016/B978-0-32-399280-0.00015-2 3 2 9 
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Condition (9.1.3) implies that the function a(t) can be positive or oscillates for a short 
time. Now let 


v:[0,c0) > R 


be a continuous function. Multiply both sides of (9.1.1) by 


elo v(s)ds 


and then integrate from 0 to any ¢ € [0, T): 
t u t u 
| elo vis)ds x'(u)du =) ax(u)elo v(s)ds gy. 
0 0 


Integrating by parts the left side and simplifying, we get 
t t t 
x(t) = xge7 0 Vs 4 / x(u)(v(u) + a)e~ Iu UTES Fi, (9.1.4) 
0 


Expression (9.1.4) is a new variation of parameters formula for (9.1.1) and of 
Volterra-type integral equation. Note that if 


v(t) = —a, 
then (9.1.4) becomes the regular solution x(t) = xoe of (9.1.1). Ina similar fashion, 
x'(t)=a(t)x(t), x(0) = x0, 


has the solution 
t t 3 
x(t) =xpe7 fords 4 i x(u)(v(u) +a(u))en Su 48 dy, (9.1.5) 
0 


Again, letting 
v(t) = —a(t), 


we get the regular known solution x(t) = xgelo a(s)ds and x(t) > 0 as t > 00, pro- 
vided that 


t 
/ a(s)ds > —c. 
0 
Again, (9.1.5) is a new variation of parameters formula that we will analyze when 
considering nonlinear equations. In the mean time, for (9.1.5), by setting up the 


proper spaces and using the contraction mapping principle, we can show that 
x(t) > 0 as t > ow, provided that 


t t 
/ |u@ + awe Ju 948 dy <a, 0<a <1, 
0 
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and 


t 
i v(s)ds > oo. 
0 


Suppose f : R x R= R is continuous and consider the nonlinear differential equa- 
tion 


x/(t) = f(t, x(t), x(0) = x0, for a given constant xo. (9.1.6) 


Then multiplying by a function is v(s)ds the solution of (9.1.6) is given by 


t t t 
x(t) =xpe7 fo 4s 4 / (xv) + f(u, x(u)))em Le 94 du, (9.1.7) 
0 
Next, we will use (9.1.7) to define a mapping on the proper space and show that the 
zero solution is AS. Let @ be the set of all real-valued continuous functions. Define 
the space 


S ={o:[0, 00) > R/d €@, || < L, O(t) > Oas t > ov}. 


Then 
(75 11< 1) 


is a complete metric space under the uniform metric 


P(1, 62) = |lo1 — g2l|, 
where 


||| = sup{|o (|: t > O}. 
Let f be locally Lipschitz on the set .7, such that 


f(t, 0) =0, (9.1.8) 
that is, for any ¢; and ¢2 € .%, we have 


f(t, 1) — F(t, 2)| S AMI|b1 — Gall (9.1.9) 


with continuous A : [0, 00) > (0, oo). Assume that for @ € .%, we have that 
t t t 
lxole7 Jo vsdds 4 Lf (Jv@w)| + A(u))em Iu 4 du < L, (9.1.10) 
0 
Note that (9.1.10) implies that 


t t 
/ (|v(u)| + d(u))e~ Ju Yds yu <a <1. 
0 
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Theorem 9.1.1. Assume (9.1.8)-(9.1.10). Suppose there exists a positive constant k 
such that 


o-fo v(s)ds <k. (9.1.11) 


Then the unique solution of (9.1.6) is bounded, and its zero solution is stable. 
If, in addition, 


t 
/ v(s)ds > o, (9.1.12) 
0 
then the zero solution of (8.5.2) is asymptotically stable. 


Proof. For ¢ € .Y, define the mapping PB: .% > Y by 


t 
0 


(Po) (t) = xye L045 4 / (p(u)v a) + fu de LO du, 9.1.13) 


It is clear that (8)(0) = xo. Now for ¢ € .Y, we have that 


: t 
|BO)O)| < beolk + i (Jo @W)Ilv@)| + A) dC |e LOR du, 


Consequently, 


t t 
IB] < |xolk + [ (Jvu@)| + A(u))e Le °4 dul |g, 


and 
Boll < |xolk +a||O|| < L, due to (9.1.10) and ge -%. (9.1.14) 
Since 8 is continuous, we have that $B: 7% — .%. Next, we show that ‘P is a con- 
traction. 
For $1, ¢2 € -Y, from (9.1.13) we have that 
t t d 
|BodO — P20 < i (|v(u)| + A(u)) em In 4 dual. = 
<al||o1 — $2. 


This shows that ‘B is a contraction. By Banach’s contraction mapping principle, $8 has 
a unique fixed point x € .”, which is a bounded continuous function. Moreover, the 
unique fixed point is a solution of (9.1.6) on [0, 00). Let x be the unique solution. Let 
€ > 0 and choose 6 = et®. If |xo| < 6, then by (9.1.14) we have that 


(1 — @)||xI| S |xolk < 8k 


or 


IIx|l Se. 
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The proof of 
|x(t)| > 0 as t— oo 


rests on condition (9.1.12), and we refer to the proof of Theorem 8.5.2. This com- 
pletes the proof. 


To see the benefits of our new inversion method, we consider a particular non- 
linear equation and rewrite it so that we can invert the usual way. Consequently, the 
contraction mapping principle will no longer work. Let 


FEDSHxe PUGE®, 
where h(t, x) satisfies a smallness condition. Thus we consider 
x’ =—x3+A(t,x). (9.1.15) 


Due to the absence of a linear term, we borrow one and try to invert the old way. We 
write (9.1.15) in the form 


x =—x +(x — x7) +A(t, x) (9.1.16) 


and then use the variation of parameters formula to obtain 


t 
x(t) =xoe! +f e~ "Ix (5) _ x3(s) + h(s, x(s))]ds. (9.1.17) 
0 


It is naive to believe that most maps can be defined so that they are contractions, even 
with the strictest conditions. To that effect, consider 


g(x) =x =, 


Then for x, y € R with |x|, |y| < See we have that 


a) 


la@) - a) =lx-2° -y+y"l Slx-yI (: 3 


and the contraction constant tends to 1 as x* + y* — 0. As a consequence, the 
regular contraction mapping principle failed to produce any results. Using (9.1.7), 
(9.1.15) has the solution 


t t t 
x(t) = xge7 Jo *)4s +f (xv) — x3 (u) + hu, xe“ "48 du, (9.1.18) 
0 


Now using the contraction mapping principle, we would have to show that a function 
of the form 


f(x) = v(r)x — x3 
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is a contraction. This is true on some bounded and small set, provided that v is of 
sufficiently small magnitude. 

Thus using (9.1.18) we can easily obtain stability and boundedness results regard- 
ing (9.1.15) under the right conditions. 


9.1.1 Periodic solutions 


Next, we apply our new method to linear or nonlinear differential equations to show 
the existence of periodic solutions without the requirement of some classic condi- 
tions. To better illustrate our approach, we let f: R x R— R anda: R— R be 
continuous and consider the nonlinear differential equation 


x’ =a(t)x(t)+ f(t, x), (9.1.19) 
where f is continuous in x. For T € R, we assume the periodicity condition 
a(tt+T)=a(t) and f(t+T,-)= f(t,:). (9.1.20) 


Let BC be the space of continuous bounded functions ¢ : R > R with the maximum 
norm || - ||. Define 


Pr ={6 € BC, Ot +T) =O()}. 


Then Pr is a Banach space endowed with the maximum norm 
||x|| = max |x(t)]. 
te[0,T] 


Also, we assume that 


elo sds yy, (9.1.21) 


Throughout this section, we assume that a(t) ~ 0 for all t € [0, T]. Now (9.1.19) 
is equivalent to 


[xine haras] = nae x(t))e~ fo ads, 


Integrating this expression from t — T to ¢ and using the fact that x(t — T) = x(t) 
give 


T = t t 
x(t) =(1-eh a) i Se xanyeli du. (9.1.22) 
1 


Theorem 9.1.2. Assume (9.1.20) and (9.1.21). Suppose the function f is Lipschitz 
continuous with Lipschitz constant k. If 


A((1 = el aenas) 


t 
/ elu WAS gy <a 
t—T 


for a € (0, 1), then (9.1.19) has a unique periodic solution. 
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Proof. Define 58 by the right side of (9.1.22). It is easily verified that (B¢)(t + T) = 
(Be)(t), and hence $8 : Pr — Pr. The rest of the proof is a direct application of the 
contraction mapping principle on the set Pr. 


On the other hand, if we take a function v(t) as before and assume that v € Pr 
with v(t) 4 0 for all t € [0, 7], then we obtain the following variation of parameters 
formula: 


T = t 
x(t) = (1 als oas) | [wow + x(u)a(u) 
t—T 
+ flu, x(u)eleatrau, (9.1.23) 


Theorem 9.1.3. Suppose v(t) 40 for all t € [0, T] and the function f is Lipschitz 
continuous with Lipschitz constant k. If 


<a 


—1 t } 
|(1 — eb was) [/ [la] +O) + fel 4 du 
i—T 


for a € (0, 1), then (9.1.19) has a unique periodic solution. 


Proof. The proof is similar to that of Theorem 9.1.2. 
Note that (9.1.23) can now handle equations of the form 
x(t) = cos(t)x(t) + f(t, x(t)). 
We easily see that 
1- oly ats)ds =|- als” cos(s)ds _ ¢, 


and hence (9.1.22) cannot be used. 


9.2 Applications to delay differential equations 


We begin by considering the following totally delayed nonlinear differential equation: 
x(t) =a(tl(x;), (9.2.1) 
where x;(t) = x(t — r) for r > 0 constant, and / = I(t) is a continuous function 


satisfying some conditions to be imposed later. Let y : [—r, 0] > R be a continuous 
initial function. We rewrite (9.2.1) in the form 


t 
x(t) =a(t+r)l(x) — =| a(s +r)l(x(s))ds 
t-r 
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=a(t+r)x(t)-—a(t+r)[x(t) -—la())] 


t 
= al a(s tr)l(x(s))ds. (9.2.2) 
t—r 


Note that we added and subtracted a(t + 1r)x, so that the inversion is possible. Thus 
by the variation of parameters formula we obtain the integral 


x(1) = wel aera 


t t 
= i els 4r)dU a(s + r)Ex(s) —Max(s))]ds 
0 


Og s 
= i: els utr)du 5 / atut+r)l(x(u))duds. (9.2.3) 
0 SJs—r 


The appearance of the term x(s) — /(x(s)) in (9.2.3) is a direct consequence of the 
borrowed term. In addition, to get any meaningful results, we would have to assume 
that /(x(t)) is odd. Otherwise, x(s) — /(x(s)) will not define a contraction. Next, we 
invert our way by assuming v : [0, 00) > R to be a nonnegative continuous func- 
tion such that 0 < ia v(s)ds =m < ow. To solve (9.2.1), we apply an inversion 


technique that starts by multiplying both sides by e/o” and then integrates them. We 
simplify the notation here and drop the ds at the end of the exponent: 


t t t Ss 
/ elo x! (s)ds = x(t)e/o” — x(0) — i xvelo” ds, 
0 0 
Therefore (9.2.1) becomes 


t t S t S 
x(neb” =x) + f xveli as + f elo "a(s)l(x,) ds, 
0 0 


4 t t t - 
rare by + [ wwe lids + | e Js a(s)l(x,)ds. (9.2.4) 
0 0 


By imposing adequate conditions on v(t), a(t), and /(t), we will prove the existence 
of bounded solutions to (9.2.1). To this end, we will use the right-hand side to define 
a contraction map on a complete metric space .”. The resulting unique fixed point 
will be the solution we are looking for. Let K > O be a constant and fix an initial 
continuous function W : [—r, 0] > R with |W(t)| < K fort € [—r, 0] and |W(0)| > 0. 
Define the space 

S :={x:[—-r,00) > R| x € @![-r, 00), ||xlloo < K, x =W on [—r, O]}, (9.2.5) 


where @![—r, 00) denotes the space of continuously differentiable functions, and 
l| - lloo is the supremum norm. By general principles, it follows that .7 is a complete 
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metric space. Define the map ‘8 on .Y by 
t t t t t 
B(x) = x(O)e7 Jo” +f xve Is "ds + / e Js ’a(s)l(x,) ds. (9.2.6) 
0 0 


The following lemma can be adapted to several different situations. 


Lemma 9.1. Let {€1, €2, £3} be a triple of positive numbers such that €, + €2 + €3 < 
1—6 for fixed 0 <6 < 1. Assume that | (0)| < €,K and m is small enough such that 
|1—e7™ | < €2. Assume that I(y) is Lipschitz on |—K, K] and satisfies |I(y)| < Cily| 
for y € [—K, K] and for some positive constant C}. Suppose that a € L!({0, 00)) 
and a la(s)|ds < om Then the map 58 has range in .Y and is a contraction. This 
implies that (9.2.1) has a unique solution in 7. 

Proof. We use the hypotheses of the theorem to bound each of the summands on the 
right-hand side of (9.2.6). The first term satisfies the bound 


|+Oyen fo 2niK. 


since |e— i *| < 1. The second summand can be bounded by 


f 
t 
i xve ds’ ds 
0 


The conditions stated above allow us to bound the third summand by 


9 
< Isl f ve Ide =e) [les Sok. 
0 


< €3||Xlloo S$ 63K. 


t t 
i e Js "a(s)l(x;) ds 
0 


Therefore 
IB(x)| < Key + Keg+ Ke3 <(1—54)K. (9.2.7) 


This implies ||$8(x)||loo < (1 — 6)K so that ‘8 has the range in . 
The contraction part follows similarly: 


t t t 
BO) — BO)! <x —yI ( [ ve ds +; i la(s)| as) (9.2.8) 


&3 
<|x-yI (a+a2) 


< (1 —8)|x — yl. 


Therefore ||[S(x) — BO) loo < AU — 4)||x — ylloo, and BP: Y > Y is a contrac- 
tion. 


Now we consider a slightly more general equation 


x'(t) =a(t)g(xr) + OGG), (9.2.9) 
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where a, b, g, G are all continuous on [—r, oo). Let us denote the right-hand side of 
(9.2.9) by L(x;). On the same space -¥ as before, we define the new map 


t t t t t 
$3(x) = xe" f wve liv as + | e Ss’ L(x,) ds. (9.2.10) 
0 0 


Impose the same conditions on v as in Lemma 9.1. The only difference now is the 
third term. We impose the following conditions: 


C1- The functions g and G are Lipschitz on [—K, K]. Explicitly, there are positive 
constants C, and Cg such that |g(y)| < Cg|y| and |G(y)| < Cg|y| for all y € 
[-K, eT 

C2- a,b€ L'({0,00)), ie la(s)|ds < IC, 3, and {5° 


S7¢5: 


Lemma 9.2. Using the notation and definitions from Lemma 9.1, under conditions 
CI-C2, the map 38: SY — fF is a contraction. 


Proof. The only difference is the third summand in the definition of L. We bound it 
as follows: 


if Pa "L(x,) ds 


€3 
2K 0,3 aCe. lake: 
(ax + ox) a 


and the rest follows similarly to the proof of Lemma 9.1. 


As a consequence, we find that (9.2.9) has a unique bounded solution in 7. 


9.2.1 The main inversion 


Now we present a more general way of inverting (9.2.9), which starts by rewriting it 
as 


x'(t)= (a+ b)g(rr) + b(GOr) — g(xr)) 


of (9.2.11) 
--5/ c(pt+r)g(x(p))dp+ct+r)gax(t)) + d1Q;,), 
t—r 


where c=a+band!=G — g. Now multiply both sides by elo” and integrate as 
before to solve for x(t). We get 


t t t 
x(t) =x(0)e~ 4 y +f aie ue Yds 
0 


t t AY 
-{ ete (s c(p + atx(p) dp) ds (9.2.12) 
0 S Js—r 


t t t t 
+f c(s + r)g(xjewss *ds +f ess “bl (x;)ds. 
0 0 
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Apply integration by parts in the middle line to get 


t t - 
x(t) =x(O)e~ ‘6 7 +f xve7ss "ds 


0 


t t t 
= rate kro) + f ve Is” F(s) ds (9.2.13) 
0 
t t t t 
+/ e(s +r)g(xjew ds vas+ [ ess *bl(x,)ds, 
0 0 


where F(t) =f’. c(p +r)g(x(p))dp. 
Again, we consider the same space .Y and define the new map 


t t i 
Bix) = x(0)e~4o . +f xve Js "ds 


0 


t t t 
= rater Fo+ f ves” F(s) ds (9.2.14) 
0 


t t t t 
+f e(s tr)g(xje ss vas+ [ ess “bl (x;)ds. 
0 0 


We need to impose a different set of conditions on the summands on the right-hand 
side of (9.2.14) to get a contraction mapping of .”. First, label the terms on the 
right-hand side as 1-7. The new bounds on the absolute values the terms now are as 
follows: 


D1- The first two summands are bounded exactly as before, that is, x(0) = Y(0) < 
€1K and ||v||;1 =m > 0, so that 1 —e7” < ep. 

D2- To bound F(r), assume that {5° |c|dt < [y° |aldt + Jy° |bldt < C406 . Here 
Cy, and Cg are the Lipschitz constants of the delayed functions. The third and 
fourth terms are each bounded above by ¢€3K. 

D3- The definitions above produce an upper bound for the fifth term equal to me3K, 
where m = [>° |v|dt. 

D4- The sixth term is again bounded above by ¢3K. 

D5- The upper bound on b above implies that the seventh term is also bounded above 
by 63K. 


Therefore 
IB(x)| < K(e1 + €2 + (m+ 4)es). (9.2.15) 


Theorem 9.2.1. If the bounds DI—DS5 above hold and there is 0 < 6 < 1 such that 
éj te2+ (m+ 4)e3 < 1 —4, then the map 8: SY — YS is a contraction with a unique 
fixed point. This fixed point is a solution to (9.2.9) that belongs to S. 


Example 9.1. Let a, B > 0 be such that 


Z=e “ g(x,) +e #G(,), (9.2.16) 
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where and f are big enough so that a~!+ B-! < Cc rag 
& 

previous conditions. Eq. (9.2.16) is a first-order differential equation with exponen- 

tially damped time-delayed terms. Theorem 9.2.1 implies the existence of a solution 


to (9.2.16) in Y. 


. This equation satisfies the 


9.2.2 Variable time delay 


Here we consider r = r(t) variable. We impose conditions on it later on. We want to 
find solutions to 


x(t) =a(t)e(x(t —r(t))) +bOGa(t —r(t))). (9.2.17) 
We still denote x(t — r(t)) by x,. The same strategy as before gives 


x'(t) = (a+ b)g(xr) + (Gr) — (xr) 
=c(t)g(x-) + bl(x,) (9.2.18) 
_ gles) 


(l—r’) + bl(x;). 
1l—r’ 


Denote f = —5; and f; = f(t — r(t)). Now we rewrite (9.2.18) as follows: 


1-r’ 


x = fra) —r)+ (FO — frgGr)C — r') + bl xr) 
= (fig) —r') — fOg@@)) + fOseO) 
+ (f(t) — frdg@r)C — 1’) + blr) 
d t 
= (5 f f(s)g(x(s))ds) + f (ga) 
(t) 


t—r 


+ (f(t) — frdg@r)C =r’) + bl (xr). 


(9.2.19) 


To simplify the upcoming expression, assume that r(0) = 0. The inversion gives 
t t t 
x(t)= x(O)e~ voy i xve—Js "ds 
0 


t t t Ss 
-[ Sorretce(mar+ | veh f@)s@@)dpds (9.2.20) 
t—r(t S 


s—r( 


t t 
+f es *(F(s)g(e(s)) + (f(s) — fr @r) (1 — #) + bIGa,)) ds. 


The most important condition to be imposed on r is |r’(t)| < « < 1 for some x 
small and positive. This condition allows us to get uniform pointwise upper bounds 
on the function f = ;5,. From the definition of 7 we impose that r(t) < r for all 
t > 0. Now we impose bounds on the different terms. 


E1- The first two summands are bounded exactly as before, that is, x(0) = V(O) < 
€1K and ||v||;1 =m > 0, so that 1 — e7” < ep. 
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E2- To bound f(t), assume that 


[oitiaesa-0' fia sa-0'(f" jaldr+ [ 1dr) 
—r —r 0 0 


< i 
~ «(Cy + Ca) 


This suffices to bound all the terms in the last line as well. 


Theorem 9.2.2. Define the map 38 on F by the right-hand side of (9.2.20). Suppose 
there are constants {&1, €2, €3} such that bounds E1l—E2 above are satisfied and such 
that €; +&2+ 2K+4 », < 1-6 for some 0 <6 <1. Then3$8: Y — Y is acontraction. 


This implies that (9.2.17) has a unique solution in -S. 


9.3 Exercises 
Exercise 9.1. Give the details for the proof of Theorem 9.1.3. 


Exercise 9.2. Use our new inversion to show the existence of periodic solutions to 
x'(t)=a(t)g(x) + b(t)G(t, xz), (9.3.1) 


where x, = x(t — L), and a(t), b(t) are continuous periodic functions with period 
L > 0. We assume that g = g(t,x) = g(t+L,x) andG=G(t,x) =G(t+L,x). 
We also assume that g and G are Lipschitz on [0, L] (and extended periodically) with 
constants Cy, and Cg, respectively. 


Exercise 9.3. Consider the equation 
x'(t) = —a(t)x(t) + e(t)x"(t — g(t) +4, x(t — g(@))). (9.3.2) 


For T > 0, define Pr = {@ € C(R, R), 6¢ + T) = ¢(H)}, where C(R, R) is the space 
of all real-valued continuous functions. Then Pr is a Banach space endowed with the 
supremum norm 


\|x|| = max |x(¢)| = max|x(7)|. 
te[0,T] teR 
Assume that 
a(tt+T)=a(t), citt+T)=c(t), gt+T)=g(t), gtt)=>s*>0 (9.3.3) 


with continuously differentiable c(t), twice continuously differentiable g(t), and con- 
stant g*. We suppose that q(t, x) is continuous in both arguments and periodic in f. 
Usually, a(t) is assumed to be positive, but here we only assume that 


T 
/ a(s)ds > 0. 
0 
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Choose a positive function v(t) = v(t + T). Multiply both sides of (9.3.2) by elo » 
and integrate by parts between t — T and ¢. 

(i) Obtain a variation of parameters formula. 

(ii) Use the results of part (i) to define a mapping $8 on Pr = {@ € C(R,R), d(t + 
T) = ¢(t)} and show that $B: Pr > Pr. 

(iii) Impose additional conditions and prove theorems parallels to Theorems 8.7.2 
and 8.7.3. 
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